Lazy filewalker errors

Node Operators troubleshooting
1

I have enabled lazy filewalker on 1.79.2 amd64 and checking the logs I’m getting the errors below. Is this expected or was something changed that fixes this between 1.79.2 and 1.79.4?
Also to add this is a relatively new node so it wouldn’t be unexpected to have 0 trashed pieces.

Thank you.

2023-05-21T02:45:07.002Z        INFO    retain  Prepared to run a Retain request.       {"process": "storagenode", "Created Before": "2023-05-16T11:59:59.823Z", "Filter Size": 239182, "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs"}
2023-05-21T02:45:07.040Z        ERROR   pieces  lazyfilewalker failed   {"process": "storagenode", "error": "lazyfilewalker: signal: broken pipe", "errorVerbose": "lazyfilewalker: signal: broken pipe\n\tstorj.io/storj/storagenode/pieces/lazyfilewalker.(*process).run:80\n\tstorj.io/storj/storagenode/pieces/lazyfilewalker.(*Supervisor).WalkSatellitePiecesToTrash:130\n\tstorj.io/storj/storagenode/pieces.(*Store).SatellitePiecesToTrash:547\n\tstorj.io/storj/storagenode/retain.(*Service).retainPieces:325\n\tstorj.io/storj/storagenode/retain.(*Service).Run.func2:221\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75"}
2023-05-21T02:46:07.758Z        INFO    retain  Moved pieces to trash during retain     {"process": "storagenode", "num deleted": 0, "Retain Status": "enabled"}

2023-05-19T11:40:34.522Z        INFO    retain  Prepared to run a Retain request.       {"process": "storagenode", "Created Before": "2023-05-15T11:59:59.111Z", "Filter Size": 239182, "Satellite ID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6"}
2023-05-19T11:40:34.560Z        ERROR   pieces  lazyfilewalker failed   {"process": "storagenode", "error": "lazyfilewalker: signal: broken pipe", "errorVerbose": "lazyfilewalker: signal: broken pipe\n\tstorj.io/storj/storagenode/pieces/lazyfilewalker.(*process).run:80\n\tstorj.io/storj/storagenode/pieces/lazyfilewalker.(*Supervisor).WalkSatellitePiecesToTrash:130\n\tstorj.io/storj/storagenode/pieces.(*Store).SatellitePiecesToTrash:547\n\tstorj.io/storj/storagenode/retain.(*Service).retainPieces:325\n\tstorj.io/storj/storagenode/retain.(*Service).Run.func2:221\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75"}
2023-05-19T11:40:34.649Z        INFO    retain  Moved pieces to trash during retain     {"process": "storagenode", "num deleted": 0, "Retain Status": "enabled"}
2

Is it a docker node or a binary node? I suppose it’s on Linux?

3

Hello @Alexey, Linux Kernel 5.15.102, amd64 binary, no docker.

4

@zip we are aware of this issue and currently working on a fix!

6 Likes
5

This looks to be now fixed with 1.80rc:

2023-05-26T12:45:36.609Z        INFO    retain  Prepared to run a Retain request.       {"Process": "storagenode", "Created Before": "2023-05-22T11:59:59.307Z", "Filter Size": 502448, "Satellite ID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6"}
2023-05-26T12:50:15.545Z        INFO    retain  Moved pieces to trash during retain     {"Process": "storagenode", "num deleted": 691, "Retain Status": "enabled"}
1 Like