Maybe the retain process is ending prematurely upon encountering a missing file, because when that is the case i can’t find the log message with the summary like this:
INFO retain Moved pieces to trash during retain {"process": "storagenode", "num deleted": 56785, "Retain Status": "enabled"}
In my nodes i have a lot of missing file errors, but all of them are from pieces that were expired before. For this big satellite the process hardly ever finish
2023-10-25T12:46:51Z INFO collector deleted expired piece {"process": "storagenode", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "ADWMEIZXPT2PKWOGAJYD2G5KNNA5NVGH7OUEAVKH7QGPBEQQCCQA"}
2023-10-25T15:53:35Z WARN retain failed to delete piece {"process": "storagenode", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "ADWMEIZXPT2PKWOGAJYD2G5KNNA5NVGH7OUEAVKH7QGPBEQQCCQA", "error": "pieces error: filestore error: file does not exist", "errorVerbose": "pieces error: filestore error: file does not exist\n\tstorj.io/storj/storagenode/blobstore/filestore.(*blobStore).Stat:110\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:245\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Trash:290\n\tstorj.io/storj/storagenode/pieces.(*Store).Trash:404\n\tstorj.io/storj/storagenode/retain.(*Service).trash:364\n\tstorj.io/storj/storagenode/retain.(*Service).retainPieces:341\n\tstorj.io/storj/storagenode/retain.(*Service).Run.func2:221\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75"}