SN Dashboard of my nodes show a decrease in used disk space for Stefan’s satellite and remaining disk space has increased during last hours, but I cannot find the piecedeleter lines in the logs corresponding to this satellite. Is anyone experiencing something simmilar?
It’s garbage collection, so that’s why you’re not seeing delete lines. Zombie segments were cleaned up on the satellite end, which triggers garbage collection to clean up the corresponding pieces on our nodes. This is a big one though, so strap in. It might take a while.
Btw, if you turn on debug logging you would see it doing its thing. But I only advise doing that when actually trying to debug something.
Lots of these:
2020-06-18T20:59:41.383Z DEBUG retain About to delete piece id {"Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Piece ID": "G3JC4E5P7BLMYBPL2Q37TBZSJZYZ6O36VP5TUS7DTZBYEMUJWVOQ", "Status": "enabled"}
2020-06-18T20:59:41.876Z DEBUG retain About to delete piece id {"Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Piece ID": "G3JGG3SEKQJXOR76DBAYZOMXYNQZFQX4URZ66QJS5BF55BZTXWSQ", "Status": "enabled"}
2020-06-18T20:59:42.398Z DEBUG retain About to delete piece id {"Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Piece ID": "G3JHY67F3FZZMZRNB4NWZDZ7ID7SH4LSVCH37WQIAS4KXDGHPFWQ", "Status": "enabled"}
2020-06-18T20:59:42.675Z DEBUG retain About to delete piece id {"Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Piece ID": "G3JK7OKXJHGACNZXNE5PYDYRFV3SLCXQUJ3J3FS6KKZKOGFEFOMA", "Status": "enabled"}
2020-06-18T20:59:42.781Z DEBUG retain About to delete piece id {"Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Piece ID": "G3JNDIH4W4KBMPQJHTP7AGUGUHKT47DSBMHCXKTLUP2OVN26MHEQ", "Status": "enabled"}
2020-06-18T20:59:42.908Z DEBUG retain About to delete piece id {"Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Piece ID": "G3JQ22M32ZKVRALKGZFPLGUZVGZV3OTEHNZF6RM5TTPKO44OZMXQ", "Status": "enabled"}
From what I can tell it only turned into garbage when the segments were cleaned up on the satellite. I think they would have been paid until that point. So it depends on what you call garbage.
Chances are your node is still working on it though. Mine is at about 20% done with it after 16 hours of processing.
Now I understand why the GE started on my oldest node finished this morning. Last night it was around 46% of progress after 10 days… and this morning it was finished! Really surprising.
I wish Storj confirmed this satellite wont be used for test anymore.
From the sudden drop in traffic, I suspect they may well reduce the amount of testing significantly and focus more on production data.
This is an interesting time for Storj in that they need to start acquiring paying customers but at the same time find ways of keeping SNOs interested enough to avoid a mass node churn.
This is not a cheap time for Storj, I suspect, and I wish them all the luck. The coolness factor of being able to “host the Cloud” in my home is phenomenal and I hope this takes off
Yes, you see the piece IDs in my example? It goes through them in alphabetical order. Letters first then numbers. It’s almost done with G there, that’s 7 out of 36 total. So about 20%.
I hope you’re right but I wouldn’t count on it. Testing has paused in the past. My node is still seeing a lot of uploads from Germany even though I’m located in the US. Seems like they are testing small files.
My Stefan-Benten blobs folder (the one that starts with abfor) now has about 16GB of data and it is holding steady for now. My Stefan trash folder has about 138GB of files inside it.
The fast majority is being deleted for me as well. It’s still going, but I can see from the folders it has already processed that at least 90% is being deleted.