ERROR collector unable to delete piece

I’m also getting those errors, it seems that it’s a recurrent problem because every once in a while they appear in groups of several files in the logs and if you dont take care they can realy spam your logs (every hour for each problematic file, ad infinitum)

The way I deal with them is creating empy files, but it should be nice if they fix the root cause.

Here is an example.

2022-03-05T01:27:42.788Z	INFO	piecestore	upload started	{"Piece ID": "C4N4EK2FR4JJRAJYXVGFK3J3P74LEIPDPANC5FWFMM5EU2OMAPHQ", "Satellite ID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6", "Action": "PUT", "Available Space": 31148600576}
2022-03-05T01:27:43.012Z	INFO	piecestore	uploaded	{"Piece ID": "C4N4EK2FR4JJRAJYXVGFK3J3P74LEIPDPANC5FWFMM5EU2OMAPHQ", "Satellite ID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6", "Action": "PUT", "Size": 145408}
2022-03-05T01:27:47.007Z	INFO	piecedeleter	delete piece sent to trash	{"Satellite ID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6", "Piece ID": "C4N4EK2FR4JJRAJYXVGFK3J3P74LEIPDPANC5FWFMM5EU2OMAPHQ"}
2022-08-26T20:38:30.722Z	ERROR	collector	unable to delete piece	{"Process": "storagenode", "Satellite ID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6", "Piece ID": "C4N4EK2FR4JJRAJYXVGFK3J3P74LEIPDPANC5FWFMM5EU2OMAPHQ", "error": "pieces error: filestore error: file does not exist", "errorVerbose": "pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:160\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57"}
2022-08-26T21:38:30.757Z	ERROR	collector	unable to delete piece	{"Process": "storagenode", "Satellite ID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6", "Piece ID": "C4N4EK2FR4JJRAJYXVGFK3J3P74LEIPDPANC5FWFMM5EU2OMAPHQ", "error": "pieces error: filestore error: file does not exist", "errorVerbose": "pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:160\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57"}

In this case the collector is trying to delete a file that was sent to the trash 5 months before :rofl:

1 Like