hello,
i have a issue with a node, some days ago i receive a mail from storj saying the node has been suspended from 2 satellites, now i access to my node and effectively i check and its offline, and the page dont show enterely information for example the wallet address is gone, version only showed “v”
i delete the container for update (i forget config the auto update for that node) i updated but now the node dont work.
i was research about “ERROR pieces:trash emptying trash failed” but in the post i see the problem is associated to out of space in disk and that its not my case
my logs from the node and df -h in the partition to the container
Filesystem Size Used Avail Use% Mounted on /dev/mapper/DINAMICO-STORYIO 555G 373G 154G 71% /storj
the logs
2021-02-19T15:05:08.554Z INFO Configuration loaded {"Location": "/app/config/config.yaml"} 2021-02-19T15:05:08.598Z INFO Operator email {"Address": "yikoru_lider@hotmail.com"} 2021-02-19T15:05:08.598Z INFO Operator wallet {"Address": "0xbdc512637E558a69DC5C78213Ce9Fc1C45bcf44b"} 2021-02-19T15:05:09.376Z INFO Telemetry enabled {"instance ID": "12sKrCX6pwingqv2zcmQ3TD3ov7qbUby67rggXLzxHmu4RGQrwA"} 2021-02-19T15:05:09.451Z INFO db.migration Database Version {"version": 50} 2021-02-19T15:05:10.159Z INFO preflight:localtime start checking local system clock with trusted satellites' system clock. 2021-02-19T15:05:16.014Z INFO preflight:localtime local system clock is in sync with trusted satellites' system clock. 2021-02-19T15:05:16.015Z INFO bandwidth Performing bandwidth usage rollups 2021-02-19T15:05:16.015Z INFO Node 12sKrCX6pwingqv2zcmQ3TD3ov7qbUby67rggXLzxHmu4RGQrwA started 2021-02-19T15:05:16.016Z INFO Public server started on [::]:28967 2021-02-19T15:05:16.016Z INFO Private server started on 127.0.0.1:7778 2021-02-19T15:05:16.016Z INFO failed to sufficiently increase receive buffer size (was: 208 kiB, wanted: 2048 kiB, got: 416 kiB). See https://github.com/lucas-clemente/quic-go/wiki/UDP-Receive-Buffer-Size for details. 2021-02-19T15:05:16.017Z INFO trust Scheduling next refresh {"after": "5h28m51.728913611s"} 2021-02-19T15:05:16.018Z ERROR services unexpected shutdown of a runner {"name": "piecestore:monitor", "error": "piecestore monitor: error verifying location and/or readability of storage directory: open config/storage/storage-dir-verification: no such file or directory", "errorVerbose": "piecestore monitor: error verifying location and/or readability of storage directory: open config/storage/storage-dir-verification: no such file or directory\n\tstorj.io/storj/storagenode/monitor.(*Service).Run.func1.1:131\n\tstorj.io/common/sync2.(*Cycle).Run:92\n\tstorj.io/storj/storagenode/monitor.(*Service).Run.func1:128\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57"} 2021-02-19T15:05:16.018Z ERROR pieces:trash emptying trash failed {"error": "pieces error: filestore error: context canceled", "errorVerbose": "pieces error: filestore error: context canceled\n\tstorj.io/storj/storage/filestore.(*blobStore).EmptyTrash:150\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).EmptyTrash:310\n\tstorj.io/storj/storagenode/pieces.(*Store).EmptyTrash:366\n\tstorj.io/storj/storagenode/pieces.(*TrashChore).Run.func1:51\n\tstorj.io/common/sync2.(*Cycle).Run:92\n\tstorj.io/common/sync2.(*Cycle).Start.func1:71\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57"} 2021-02-19T15:05:16.018Z ERROR pieces:trash emptying trash failed {"error": "pieces error: filestore error: context canceled", "errorVerbose": "pieces error: filestore error: context canceled\n\tstorj.io/storj/storage/filestore.(*blobStore).EmptyTrash:150\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).EmptyTrash:310\n\tstorj.io/storj/storagenode/pieces.(*Store).EmptyTrash:366\n\tstorj.io/storj/storagenode/pieces.(*TrashChore).Run.func1:51\n\tstorj.io/common/sync2.(*Cycle).Run:92\n\tstorj.io/common/sync2.(*Cycle).Start.func1:71\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57"} 2021-02-19T15:05:16.018Z ERROR pieces:trash emptying trash failed {"error": "pieces error: filestore error: context canceled", "errorVerbose": "pieces error: filestore error: context canceled\n\tstorj.io/storj/storage/filestore.(*blobStore).EmptyTrash:150\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).EmptyTrash:310\n\tstorj.io/storj/storagenode/pieces.(*Store).EmptyTrash:366\n\tstorj.io/storj/storagenode/pieces.(*TrashChore).Run.func1:51\n\tstorj.io/common/sync2.(*Cycle).Run:92\n\tstorj.io/common/sync2.(*Cycle).Start.func1:71\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57"} 2021-02-19T15:05:16.019Z ERROR pieces:trash emptying trash failed {"error": "pieces error: filestore error: context canceled", "errorVerbose": "pieces error: filestore error: context canceled\n\tstorj.io/storj/storage/filestore.(*blobStore).EmptyTrash:150\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).EmptyTrash:310\n\tstorj.io/storj/storagenode/pieces.(*Store).EmptyTrash:366\n\tstorj.io/storj/storagenode/pieces.(*TrashChore).Run.func1:51\n\tstorj.io/common/sync2.(*Cycle).Run:92\n\tstorj.io/common/sync2.(*Cycle).Start.func1:71\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57"} 2021-02-19T15:05:16.019Z ERROR pieces:trash emptying trash failed {"error": "pieces error: filestore error: context canceled", "errorVerbose": "pieces error: filestore error: context canceled\n\tstorj.io/storj/storage/filestore.(*blobStore).EmptyTrash:150\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).EmptyTrash:310\n\tstorj.io/storj/storagenode/pieces.(*Store).EmptyTrash:366\n\tstorj.io/storj/storagenode/pieces.(*TrashChore).Run.func1:51\n\tstorj.io/common/sync2.(*Cycle).Run:92\n\tstorj.io/common/sync2.(*Cycle).Start.func1:71\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57"} 2021-02-19T15:05:16.019Z ERROR collector error during collecting pieces: {"error": "piece expiration error: context canceled", "errorVerbose": "piece expiration error: context canceled\n\tstorj.io/storj/storagenode/storagenodedb.(*pieceExpirationDB).GetExpired:39\n\tstorj.io/storj/storagenode/pieces.(*Store).GetExpired:520\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:88\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:92\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:81\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:80\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57"} 2021-02-19T15:05:16.019Z ERROR piecestore:cache error getting current used space: {"error": "context canceled; context canceled; context canceled; context canceled; context canceled; context canceled", "errorVerbose": "group:\n--- context canceled\n--- context canceled\n--- context canceled\n--- context canceled\n--- context canceled\n--- context canceled"} 2021-02-19T15:05:16.020Z ERROR nodestats:cache Get pricing-model/join date failed {"error": "context canceled"} Error: piecestore monitor: error verifying location and/or readability of storage directory: open config/storage/storage-dir-verification: no such file or directory