Dear Support,
I found the problem on 19 month node, i trying to fix the db problem and restart node still error. All the /home/storj/storage/ “*.DB” already backup and detail below.
Please help. thanks. 
1.
sqlite3 /home/storj/storage/orders.db “PRAGMA integrity_check;”
*** in database main ***
On tree page 3 cell 179: Rowid 2986696 out of order
On tree page 3 cell 178: Rowid 2986688 out of order
On tree page 3 cell 177: Rowid 2986680 out of order
On tree page 3 cell 176: Rowid 2986672 out of order
On tree page 3 cell 175: Rowid 2986664 out of order
On tree page 3 cell 174: Rowid 2986656 out of order
On tree page 3 cell 173: Rowid 2986648 out of order
On tree page 3 cell 172: Rowid 2986640 out of order
On tree page 3 cell 171: Rowid 2986632 out of order
On tree page 3 cell 169: Rowid 2986616 out of order
On tree page 3 cell 154: Rowid 2986496 out of order
On tree page 3 cell 153: Rowid 2986488 out of order
On tree page 3 cell 152: Rowid 2986480 out of order
On tree page 3 cell 151: Rowid 2986472 out of order
On tree page 3 cell 150: Rowid 2986464 out of order
On tree page 3 cell 133: Rowid 2986328 out of order
On tree page 3 cell 132: Rowid 2986320 out of order
On tree page 3 cell 131: Rowid 2986312 out of order
On tree page 39207 cell 7: Rowid 5912 out of order
On tree page 39208 cell 7: Rowid 6040 out of order
On tree page 39212 cell 7: Rowid 5304 out of order
On tree page 39215 cell 7: Rowid 5192 out of order
On tree page 912 cell 304: 2nd reference to page 39208
On tree page 912 cell 288: 2nd reference to page 39207
On tree page 912 cell 212: 2nd reference to page 39212
On tree page 912 cell 198: 2nd reference to page 39215
On tree page 912 cell 190: 2nd reference to page 39210
On tree page 912 cell 182: 2nd reference to page 39206
On tree page 912 cell 135: 2nd reference to page 39213
On tree page 911 cell 202: 2nd reference to page 9107
On tree page 911 cell 125: 2nd reference to page 38568
On tree page 911 cell 123: 2nd reference to page 29072
On tree page 911 cell 121: 2nd reference to page 32484
On tree page 911 cell 119: 2nd reference to page 38101
On tree page 911 cell 118: 2nd reference to page 30270
On tree page 911 cell 117: 2nd reference to page 38486
On tree page 911 cell 115: 2nd reference to page 10368
On tree page 911 cell 113: 2nd reference to page 36092
On tree page 911 cell 111: 2nd reference to page 12224
On tree page 911 cell 110: 2nd reference to page 4929
On tree page 911 cell 109: 2nd reference to page 32379
On tree page 911 cell 108: 2nd reference to page 36840
On tree page 911 cell 105: 2nd reference to page 38023
On tree page 911 cell 104: 2nd reference to page 29298
On tree page 911 cell 103: 2nd reference to page 30114
On tree page 911 cell 60: 2nd reference to page 16056
On tree page 911 cell 57: 2nd reference to page 22905
On tree page 38468 cell 7: Rowid 896 out of order
On tree page 911 cell 55: 2nd reference to page 32372
On tree page 32341 cell 7: Rowid 776 out of order
On tree page 911 cell 52: 2nd reference to page 23216
On tree page 911 cell 51: 2nd reference to page 32863
On tree page 30242 cell 7: Rowid 944 out of order
On tree page 911 cell 49: 2nd reference to page 29484
On tree page 911 cell 48: 2nd reference to page 36909
On tree page 30386 cell 2: Rowid 388 out of order
On tree page 911 cell 46: 2nd reference to page 38411
On tree page 38269 cell 7: Rowid 784 out of order
On tree page 911 cell 44: 2nd reference to page 35487
On tree page 33304 cell 7: Rowid 792 out of order
On tree page 911 cell 42: 2nd reference to page 28993
On tree page 17203 cell 7: Rowid 808 out of order
On tree page 911 cell 38: 2nd reference to page 24653
On tree page 911 cell 37: 2nd reference to page 32093
On tree page 911 cell 36: 2nd reference to page 32865
On tree page 911 cell 35: 2nd reference to page 26114
On tree page 28753 cell 7: Rowid 816 out of order
On tree page 911 cell 33: 2nd reference to page 33999
On tree page 911 cell 32: 2nd reference to page 38718
On tree page 911 cell 31: 2nd reference to page 26402
On tree page 911 cell 30: 2nd reference to page 32402
On tree page 911 cell 29: 2nd reference to page 2241
On tree page 911 cell 28: 2nd reference to page 28852
On tree page 911 cell 27: 2nd reference to page 28413
On tree page 911 cell 26: 2nd reference to page 38317
On tree page 911 cell 25: 2nd reference to page 1097
On tree page 911 cell 24: 2nd reference to page 5228
On tree page 5020 cell 7: Rowid 824 out of order
On tree page 911 cell 22: 2nd reference to page 28692
On tree page 911 cell 21: 2nd reference to page 31137
On tree page 911 cell 20: 2nd reference to page 33198
On tree page 911 cell 19: 2nd reference to page 5294
On tree page 30642 cell 7: Rowid 832 out of order
On tree page 24372 cell 7: Rowid 904 out of order
On tree page 911 cell 15: 2nd reference to page 5156
On tree page 5158 cell 7: Rowid 912 out of order
On tree page 911 cell 13: 2nd reference to page 32201
On tree page 911 cell 12: 2nd reference to page 28859
On tree page 911 cell 11: 2nd reference to page 23694
On tree page 27377 cell 7: Rowid 920 out of order
On tree page 911 cell 9: 2nd reference to page 30204
On tree page 911 cell 8: 2nd reference to page 9846
On tree page 911 cell 7: 2nd reference to page 32493
On tree page 38526 cell 7: Rowid 840 out of order
On tree page 911 cell 4: 2nd reference to page 1038
On tree page 32655 cell 7: Rowid 712 out of order
On tree page 9682 cell 7: Rowid 928 out of order
On tree page 32165 cell 7: Rowid 936 out of order
On tree page 9 cell 7: Rowid 704 out of order
On tree page 324271 cell 17: 2nd reference to page 1749
2
Used the sqlite3 to fix the orders.db problem and show
sqlite3 /home/storj/storage/orders.db “PRAGMA integrity_check;”
ok
3
copy the new orders.db to /home/storj/storage/ and restart the node.
4
docker logs --tail 50 storagenode
X = Hidden
2020-10-14T04:25:29.635Z INFO Configuration loaded {"Location": "/app/config/config.yaml"}
2020-10-14T04:25:29.661Z INFO Operator email {"Address": "XXXXXXXXX@mail.com"}
2020-10-14T04:25:29.661Z INFO Operator wallet {"Address": "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"}
2020-10-14T04:25:30.050Z INFO Telemetry enabled
2020-10-14T04:25:30.055Z INFO db.migration Database Version {"version": 45}
Error: Error during preflight check for storagenode databases: preflight: database "orders": expected schema does not match actual: &dbschema.Schema{
Tables: {&{Name: "order_archive_", Columns: {&{Name: "archived_at", Type: "TIMESTAMP"}, &{Name: "order_limit_serialized", Type: "BLOB"}, &{Name: "order_serialized", Type: "BLOB"}, &{Name: "satellite_id", Type: "BLOB"}, ...}}, &{Name: "unsent_order", Columns: {&{Name: "order_limit_expiration", Type: "TIMESTAMP"}, &{Name: "order_limit_serialized", Type: "BLOB"}, &{Name: "order_serialized", Type: "BLOB"}, &{Name: "satellite_id", Type: "BLOB"}, ...}}},
Indexes: []*dbschema.Index{
&{Name: "idx_order_archived_at", Table: "order_archive_", Columns: {"archived_at"}},
- s`Index<Table: unsent_order, Name: idx_orders, Columns: satellite_id serial_number, Unique: true, Partial: "">`,
},
}
storj.io/storj/storagenode/storagenodedb.(*DB).Preflight:424
main.cmdRun:199
storj.io/private/process.cleanup.func1.4:362
storj.io/private/process.cleanup.func1:380
github.com/spf13/cobra.(*Command).execute:842
github.com/spf13/cobra.(*Command).ExecuteC:950
github.com/spf13/cobra.(*Command).Execute:887
storj.io/private/process.ExecWithCustomConfig:88
storj.io/private/process.ExecCustomDebug:70
main.main:335
runtime.main:204
All other information:
Error orders.db size: 1.3G orders.db
New orders.db size: 1.2G orders.db (sqlite3 after)
/home/storj/orders/unsent have a 515M unsent file ( from Sep 6 to 14 Oct 2020 )
