Hi all, been getting this error and from searching, i found this and repaired bandwidth.db.
https://forum.storj.io/t/database-error-error-piecestore-failed-to-add-bandwidth-usage/3044
I went ahead and repaired bandwidth.db using this guide and it took about a day to repair:
https://support.storj.io/hc/en-us/articles/360029309111-How-to-fix-a-database-disk-image-is-malformed
But now, restarted the node and I still see the same error, help!
2023-04-21T13:57:15.885Z INFO piecestore download started {"Process": "storagenode", "Piece ID": "KFD2XTKI3F3BKIFVTCF6MMN47XV6SXGOVBR3ZHLO4RNW7AL3KIEQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET_REPAIR", "Offset": 0, "Size": 22784, "Remote Address": "172.17.0.1:55026"}
2023-04-21T13:57:16.377Z ERROR piecestore failed to add bandwidth usage {"Process": "storagenode", "error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:852\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:505\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2023-04-21T13:57:16.377Z ERROR piecestore upload failed {"Process": "storagenode", "Piece ID": "EG3QZNERMRWYVMUYQX4SHWXQEEXWNK4CNL6CS4HPR2EUM2FRSAHA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "error": "context canceled", "errorVerbose": "context canceled\n\tstorj.io/common/rpc/rpcstatus.Wrap:75\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload.func5:498\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:504\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35", "Size": 15104, "Remote Address": "172.17.0.1:38856"}
2023-04-21T13:57:16.768Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "7LTTSR4B7MBCEIJFIZQUKKQU63T53IBQHBUV3XYBHP6UH7NKII4A", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158552032, "Remote Address": "172.17.0.1:55030"}
2023-04-21T13:57:16.768Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "JFSRYMNPY4XDSZMOGSWPA5WBG4PHN4PP5VSNUPYJB35MSSKHTB6Q", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158552032, "Remote Address": "172.17.0.1:55024"}
2023-04-21T13:57:16.768Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "MMI2LVN4X6ZOTOHJV2MYFZXWJ6V32RQGYWKLJOR45RX6BZMMOGDA", "Satellite ID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB", "Action": "PUT_REPAIR", "Available Space": 8927158552032, "Remote Address": "172.17.0.1:55028"}
2023-04-21T13:57:17.744Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "6YVOJSTCPSJGI56FE4MNUQTQ3CN3CATGGUEYOVNUCFR34YW633UQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158514912, "Remote Address": "172.17.0.1:55036"}
2023-04-21T13:57:18.174Z INFO piecestore download started {"Process": "storagenode", "Piece ID": "C3URKTXQPOCQKFLX4XFY2AQCDRTPYYYXBHKJKB2MVTLIRIKTKQWQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET_REPAIR", "Offset": 0, "Size": 33280, "Remote Address": "172.17.0.1:55040"}
2023-04-21T13:57:19.649Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "ZG22N7W47U7PITB3EUTOJLAPFOYWMXPHRGM3HO6OT4MYX36NH4TQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158494688, "Remote Address": "172.17.0.1:55038"}
2023-04-21T13:57:19.650Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "TH74QK5536LE5ISIXR6BUG6AIBVT2SLUMLCFIM6IJXRGNRBXUQMA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158494688, "Remote Address": "172.17.0.1:55032"}
2023-04-21T13:57:20.101Z ERROR piecestore failed to add bandwidth usage {"Process": "storagenode", "error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:852\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:505\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2023-04-21T13:57:20.101Z INFO piecestore uploaded {"Process": "storagenode", "Piece ID": "E7G64QFY6P7MYNXFPCFD2WT77TI2RQXSWOU7IGGKWBFD45O5BLSQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Size": 3840, "Remote Address": "172.17.0.1:39880"}
2023-04-21T13:57:20.505Z ERROR piecestore failed to add bandwidth usage {"Process": "storagenode", "error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:852\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download.func7:766\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:780\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:251\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2023-04-21T13:57:20.576Z INFO piecestore download canceled {"Process": "storagenode", "Piece ID": "A2553ITGDWOG7IGJZ5DYDHVXLAUFLZTJQXFK4JNCBVY5Z6NLVGXQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 0, "Remote Address": "172.17.0.1:48520"}
2023-04-21T13:57:20.576Z INFO piecestore download started {"Process": "storagenode", "Piece ID": "P4XBERHECSVPGLT5AUC3BD6WOUMB6ZBF5CPSGGR3MYKNWGGLGKIA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 73984, "Remote Address": "172.17.0.1:48520"}
2023-04-21T13:57:20.577Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "XETMNXLA4GM647F4K66T5BN5Q465AWOCRPT5NIVUXGG235Z2FIBA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158457312, "Remote Address": "172.17.0.1:39880"}
2023-04-21T13:57:20.578Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "MGQHCXI3ZUD4SSM5ZL6F2NXZLRSMCVNGZSNAHM5PPY366AGI4J3Q", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158457312, "Remote Address": "172.17.0.1:55034"}
2023-04-21T13:57:20.679Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "4NPS6LM7GNZOSMU5CSHBPRO3KUMD5ZR4NWCCMGG63SQXW7HLD26A", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158449888, "Remote Address": "172.17.0.1:55046"}
2023-04-21T13:57:20.680Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "UQTM5REBRXSM4KHCMACNOZS35TNS6DPEKPRIMNRILGKUVSZMN52Q", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158449888, "Remote Address": "172.17.0.1:55048"}
2023-04-21T13:57:21.627Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "65E5FNF35TYBOWKAUL6D2EYEJYSL4JXNGI3OVPKBI3ULHPY4DCMA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158449888, "Remote Address": "172.17.0.1:55012"}
2023-04-21T13:57:21.627Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "Y5NH5KMCYRZEWLKIYNHIIICK54C7CWY2RPGSPPB6ACXG6RRH5F3Q", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158449888, "Remote Address": "172.17.0.1:55052"}
2023-04-21T13:57:22.582Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "P5QF2GU2YQ5AT6TFXSBALUK66JC4JCWH6P6QLHBHY4SKKUTV2GNQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158449888, "Remote Address": "172.17.0.1:55056"}
2023-04-21T13:57:22.582Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "MOJ6543WQZJST7ZZICESLGZ756GVC2W64Q47AURBGHMHDJBLV72Q", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158449888, "Remote Address": "172.17.0.1:55044"}
2023-04-21T13:57:22.584Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "TWU6EI2PJYUTUG7WWKE2XBEB6FYUKUMWLJIOP7VANCJ63TN6OG5A", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158449888, "Remote Address": "172.17.0.1:55050"}
2023-04-21T13:57:22.582Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "X2TSXF25HLNGTRE7TPXNXFLFBP6CRRZHRWRXQBSR2ZLAJQP3W35Q", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158449888, "Remote Address": "172.17.0.1:55054"}
2023-04-21T13:57:23.513Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "CWGGPWO7A6TY7J36IKHCJETVECS6ISEQ7323HOJHXJJDVUPBASWQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158449888, "Remote Address": "172.17.0.1:55060"}
2023-04-21T13:57:23.513Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "LOANDXL2JCVYLMCOYTOZXAQISTMYK2SRVI6VNVACQ3YUYPHTTQ4A", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158449888, "Remote Address": "172.17.0.1:55062"}
2023-04-21T13:57:24.842Z ERROR piecestore failed to add bandwidth usage {"Process": "storagenode", "error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:852\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:505\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2023-04-21T13:57:24.842Z INFO piecestore uploaded {"Process": "storagenode", "Piece ID": "6652AZQNUMHIL4GRYXIEEKV7I2R5SIEUNPEINAMEW44WACTXQOIQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Size": 24320, "Remote Address": "172.17.0.1:39184"}
2023-04-21T13:57:25.399Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "UYTV7AFAEARFIBNEK2DX2MQ4SIDOKDEQZ4MRVFSHTIY5EESOKG3A", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158363104, "Remote Address": "172.17.0.1:55064"}
2023-04-21T13:57:25.399Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "5GCC3C4CS7PHYXAUD3PY446OWDSJCDPBAVDOYLVVYMZK6K5VHTGQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158363104, "Remote Address": "172.17.0.1:55066"}
2023-04-21T13:57:25.400Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "7L2B5LRLFIIJH5UFXI6MVVFMLTPR6JIEKZGVTA5QH7VWAHLYP2SQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158363104, "Remote Address": "172.17.0.1:39184"}
2023-04-21T13:57:25.475Z INFO piecestore download started {"Process": "storagenode", "Piece ID": "ZHF5WXLYKPOFG42NAK4SOX664JCKCIV3WNVGXV56ACMIWNJ6A2KA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 36608, "Remote Address": "172.17.0.1:55070"}
2023-04-21T13:57:26.027Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "GSA3E6XSZNXY2X7H7SVETSXW42RIX4F5LWXZQGUC3MKHHLQMKRQA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158355168, "Remote Address": "172.17.0.1:55076"}
2023-04-21T13:57:26.456Z ERROR piecestore failed to add bandwidth usage {"Process": "storagenode", "error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:852\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:505\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2023-04-21T13:57:26.456Z ERROR piecestore upload failed {"Process": "storagenode", "Piece ID": "KWNQTDGBETXQKTQQ5MRVB4PLBO7C5MDFEMCA5ICOEMW7PRCR3BNQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "error": "context canceled", "errorVerbose": "context canceled\n\tstorj.io/common/rpc/rpcstatus.Wrap:75\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload.func5:498\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:504\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35", "Size": 27392, "Remote Address": "172.17.0.1:39774"}
2023-04-21T13:57:27.340Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "I2G2BSD4VZFCP2FZ5ABO7RPG6GOQ2CASPKML4KJDMJQPVK2F2KLA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158353120, "Remote Address": "172.17.0.1:55078"}
2023-04-21T13:57:27.340Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "G4JLMI5ZOOBJXMJ7EG3UYFZQU3I5OGFABU6OVBESGFHTPFLJPGVQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158353120, "Remote Address": "172.17.0.1:55072"}
2023-04-21T13:57:27.340Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "FQIKVGKWM27SJF4LT5UGCBEFMCCZO262TTVDZXPQHZ45GVAN2C4Q", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158353120, "Remote Address": "172.17.0.1:55042"}
2023-04-21T13:57:27.341Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "CLI3JSGT3GYLV2B4WSQP43UV3AUZRHF6KV5UWB566NX6B7YZQB7Q", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158353120, "Remote Address": "172.17.0.1:55080"}
2023-04-21T13:57:28.398Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "UODTPOT4WQRFVAWZ4YQ4TEUBT5VLYNLCQAZNZBKDLDVE2P2MWPLA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158334944, "Remote Address": "172.17.0.1:55068"}
2023-04-21T13:57:28.931Z INFO piecestore download started {"Process": "storagenode", "Piece ID": "UA7S5GBMKLXXSEXRMQ2AF6S2OJZBAONQR5L7FZHFPZNQQENY3THQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET_REPAIR", "Offset": 0, "Size": 75008, "Remote Address": "172.17.0.1:55092"}
2023-04-21T13:57:29.059Z INFO piecestore download started {"Process": "storagenode", "Piece ID": "S46LLOZYMJZVN2XXK5AHGWNN3O2IY5VST3TLDJOEQYDLWMDVKN5Q", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "GET", "Offset": 0, "Size": 7680, "Remote Address": "172.17.0.1:55094"}
2023-04-21T13:57:29.281Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "N33IYGNIIV4RLMFWIXN3VWFSJ4N7HRVIUG4XFONG7YFYVCYNDKDQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158323424, "Remote Address": "172.17.0.1:55058"}
2023-04-21T13:57:30.198Z ERROR piecestore failed to add bandwidth usage {"Process": "storagenode", "error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:852\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:530\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2023-04-21T13:57:30.198Z INFO piecestore uploaded {"Process": "storagenode", "Piece ID": "2FM4F3LGQRGFD2CMQFFBEBLYWOYUN6DSOUXBRFLKFXRDTXX6EX6Q", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT_REPAIR", "Size": 3584, "Remote Address": "172.17.0.1:41482"}
2023-04-21T13:57:30.202Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "EQ6PZLDLWS4OJSBJBREVZGBKKA2JJLHIPU5AOHOVDR4OFM7UBNWA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158305504, "Remote Address": "172.17.0.1:55096"}
2023-04-21T13:57:30.600Z ERROR piecestore failed to add bandwidth usage {"Process": "storagenode", "error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:852\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:530\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2023-04-21T13:57:30.601Z INFO piecestore uploaded {"Process": "storagenode", "Piece ID": "EYA6LFCX3X2E5O7G3ETXK6K7ILZUQHPUQHPAPZN42GHLD7XQB2TA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Size": 82688, "Remote Address": "172.17.0.1:41098"}
2023-04-21T13:57:31.167Z INFO piecestore upload started {"Process": "storagenode", "Piece ID": "JUIKPUI34CYGPRMAAV4HDWL2NOW7QBYNQQ6ATUHNKPFS654LQWYA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 8927158301920, "Remote Address": "172.17.0.1:55100"}