Does it make sense that there was no traffic in my node in the last 5 days?
the Ingres and egres did not change
Can you show output of this command?
docker logs --tail 20 storagenode
2020-01-14T11:49:04.186Z INFO piecestore uploaded {“Piece ID”: “WF5ZVCWXGPKXZCYFGGNSIK7AZM4RECV6WRVRQVKM53L7WMX6WAKQ”, “Satellite ID”: “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”, “Action”: “PUT”}
2020-01-14T11:49:04.593Z ERROR piecestore failed to add order {“error”: “ordersdb error: database disk image is malformed”, “errorVerbose”: “ordersdb error: database disk image is malformed\n\tstorj.io/storj/storagenode/storagenodedb.(*ordersDB).Enqueue:52\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).saveOrder:717\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).doUpload:471\n\tstorj.io/storj/storagenode/piecestore.(*drpcEndpoint).Upload:268\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:1066\n\tstorj.io/drpc/drpcserver.(*Server).doHandle:175\n\tstorj.io/drpc/drpcserver.(*Server).HandleRPC:153\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:114\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:147\n\tstorj.io/drpc/drpcctx.(*Tracker).track:51”}
2020-01-14T11:49:04.593Z INFO piecestore uploaded {“Piece ID”: “XEBPEVLJ43K6NRIJKN5SM3OVU3MQKXOTRF3OX76WKG7P2VTDDPOQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-01-14T11:49:05.525Z ERROR piecestore failed to add order {“error”: “ordersdb error: database disk image is malformed”, “errorVerbose”: “ordersdb error: database disk image is malformed\n\tstorj.io/storj/storagenode/storagenodedb.(*ordersDB).Enqueue:52\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).saveOrder:717\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).doDownload.func4:676\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).doDownload:701\n\tstorj.io/storj/storagenode/piecestore.(*drpcEndpoint).Download:488\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:1074\n\tstorj.io/drpc/drpcserver.(*Server).doHandle:175\n\tstorj.io/drpc/drpcserver.(*Server).HandleRPC:153\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:114\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:147\n\tstorj.io/drpc/drpcctx.(*Tracker).track:51”}
2020-01-14T11:49:05.525Z INFO piecestore download failed {“Piece ID”: “UD7VKA7I5TEYZNFG6LSLA3DMENC6PRMKJQUSWSVQMDMKIYZBHQYA”, “Satellite ID”: “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”, “Action”: “GET”, “error”: “piecestore: piecestore protocol: context canceled”, “errorVerbose”: “piecestore: piecestore protocol: context canceled\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).doDownload.func3:652\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-01-14T11:49:05.751Z INFO piecestore download started {“Piece ID”: “4TXH5I6O4C5VL6T6RHACPZUF2353WNHPMYKWVFI3IPUVRN5IG36Q”, “Satellite ID”: “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”, “Action”: “GET”}
2020-01-14T11:49:11.276Z INFO piecestore upload started {“Piece ID”: “XUQB4YLYGM4QZXHXUHSHOTH252SYCBFQ4XHBUMOZMT6GVFV44PKQ”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “Action”: “PUT”}
2020-01-14T11:49:11.545Z INFO piecestore download started {“Piece ID”: “54FEP6A73EEEF5MRYLQRPJHWN2N46C453SJD6QUNI7OVSKFFOQ7Q”, “Satellite ID”: “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”, “Action”: “GET”}
2020-01-14T11:49:13.392Z ERROR piecestore failed to add order {“error”: “ordersdb error: database disk image is malformed”, “errorVerbose”: “ordersdb error: database disk image is malformed\n\tstorj.io/storj/storagenode/storagenodedb.(*ordersDB).Enqueue:52\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).saveOrder:717\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).doDownload.func4:676\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).doDownload:701\n\tstorj.io/storj/storagenode/piecestore.(*drpcEndpoint).Download:488\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:1074\n\tstorj.io/drpc/drpcserver.(*Server).doHandle:175\n\tstorj.io/drpc/drpcserver.(*Server).HandleRPC:153\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:114\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:147\n\tstorj.io/drpc/drpcctx.(*Tracker).track:51”}
2020-01-14T11:49:13.392Z INFO piecestore downloaded {“Piece ID”: “RBIW4I5CTHTQU7UZM6OJLAI3JDNWCNL3THA3N5XNX6WHJ2WF5SPQ”, “Satellite ID”: “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”, “Action”: “GET”}
2020-01-14T11:49:13.794Z ERROR piecestore failed to add order {“error”: “ordersdb error: database disk image is malformed”, “errorVerbose”: “ordersdb error: database disk image is malformed\n\tstorj.io/storj/storagenode/storagenodedb.(*ordersDB).Enqueue:52\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).saveOrder:717\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).doDownload.func4:676\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).doDownload:701\n\tstorj.io/storj/storagenode/piecestore.(*drpcEndpoint).Download:488\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:1074\n\tstorj.io/drpc/drpcserver.(*Server).doHandle:175\n\tstorj.io/drpc/drpcserver.(*Server).HandleRPC:153\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:114\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:147\n\tstorj.io/drpc/drpcctx.(*Tracker).track:51”}
2020-01-14T11:49:13.795Z INFO piecestore download failed {“Piece ID”: “ITMDYVMEE73DV2KQU5WWYAFNECGZNJI22CA2PPIGHF42VVWOREDA”, “Satellite ID”: “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”, “Action”: “GET”, “error”: “piecestore: piecestore protocol: write tcp 192.168.50.7:28967->116.203.250.2:54194: use of closed network connection”, “errorVerbose”: “piecestore: piecestore protocol: write tcp 192.168.50.7:28967->116.203.250.2:54194: use of closed network connection\n\tstorj.io/drpc/drpcstream.(*Stream).pollWrite:189\n\tstorj.io/drpc/drpcwire.SplitN:25\n\tstorj.io/drpc/drpcstream.(*Stream).RawWrite:233\n\tstorj.io/drpc/drpcstream.(*Stream).MsgSend:266\n\tstorj.io/common/pb.(*drpcPiecestoreDownloadStream).Send:1168\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).doDownload.func3:643\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-01-14T11:49:15.812Z INFO piecestore download started {“Piece ID”: “HZYNZM2OKYFH6XFZI6NVOLMOI2CQR4FRTON2F6E2FCJYN5VT5FRQ”, “Satellite ID”: “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”, “Action”: “GET”}
2020-01-14T11:49:17.070Z ERROR piecestore failed to add order {“error”: “ordersdb error: database disk image is malformed”, “errorVerbose”: “ordersdb error: database disk image is malformed\n\tstorj.io/storj/storagenode/storagenodedb.(*ordersDB).Enqueue:52\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).saveOrder:717\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).doUpload:471\n\tstorj.io/storj/storagenode/piecestore.(*drpcEndpoint).Upload:268\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:1066\n\tstorj.io/drpc/drpcserver.(*Server).doHandle:175\n\tstorj.io/drpc/drpcserver.(*Server).HandleRPC:153\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:114\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:147\n\tstorj.io/drpc/drpcctx.(*Tracker).track:51”}
2020-01-14T11:49:17.070Z INFO piecestore uploaded {“Piece ID”: “XUQB4YLYGM4QZXHXUHSHOTH252SYCBFQ4XHBUMOZMT6GVFV44PKQ”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “Action”: “PUT”}
You have a corrupted database. You will need to follow below guide to fix it.
1 Like
I’m no expert but, It looks like you ran the procedure on bandwidth.db, however your log file seems to suggest a problem with the orders.db database. I believe the instructions are just using bandwidth.db as an example and you need to change bandwidth.db to the name of the database that you are trying to fix.
1 Like
I need to run it on all DB files?
I’d only do the repair for the ones that are corrupted.
The first step is the integrity check to see if the database is damaged.
when you do “sqlite3 /path/to/storage/bandwidth.db “PRAGMA integrity_check;”” , if it says ok, than the database is ok and does not need repair. Try the integrity check on orders.db instead of bandwith.db to see if it is damaged. Make sure you have a backup of your database files first in case something goes wrong.
3 Likes
I’m surprised that SNOs would have to take care of such things themselves… For pro users already used to hosting data and managing servers why not, but home users should not have to worry about anything.
I think nodes should be as much autonomous as possible. If a file gets corrupted, the node should fix itself when there’s a known procedure… Right?
Personnally, I’m not planning on monitoring logs for Storj errors… I’d like the node to live its life on its own.
I’m just providing power, network and storage… All the rest should be fully automated I think 
1 Like