Good news first, the piece is no longer in the blobs folder. I don’t know where it has gone and what has removed it.
The extent of the problem is pure random. Larger pieces, more satellites, more uploads and it scales.
Why not move the piece that we know we don’t need it to the trash immediately when the log line of the failed upload gets logged instead of filling the nodes up with garbage? It is my understanding that moving does not cost I/O. Of course to delete it immediately would be better, but if it was moved to trash then we could be at least sure that it will be deleted after 7 days.
BTW that is not the only garbage nodes get filled up with. There is literally the unpaid trash and the temp folder:
The latter doesn’t even get cleaned up by software at all.
I would certainly prefer to see the storagenode software being less messy and space wasting than it is today.