If you remove the database. Some data on the dashboard will be lost. Most of it will return over time except for the bandwidth data from previous days. This is normal. The space used statistics will come back after the used space file walker has completed.
So if I understand correctly, I did it right, I just need to wait for the data to resynchronize? I won’t be excluded because of this?
I just delete used_space_per_prefix.db and restart the node to run the used space file walker. I do not lose as many stats this way. Also, are you using the badger cache? I only delete all the DB as a last resort but I don’t believe it hurts the node. The choice is yours.
Yes, if the file walker is running, it can take a long time to finish.
Trash, Trash and more trash. That aint paid for…
This is just 1 machine out of the 5 i got running around the world.
In my eyes its supid. Many nodes are full, meaning no more data, yet 25% of it is trash - over 2.5TB on some nodes, and therefor i “loose” earnings because i cant eat more ingress and trash is unaid because storj want their “free” security! how is it fair?
True, but the full nodes situation is improving. My node just finished deleting a lot of the trash from EU1 a few minutes ago and I believe many other nodes have already deleted their trash. In the last couple days the number of full nodes has gone from about 6200 to 3500.
And yes this is great.
But the fact still remains, its not the first time we see piles and piles of trash, that we, the SNO’s have to pay for, and not only pay for, but also miss out on new data because of. its a loose/loose for us.
Do some people maybe have old trash folders sticking around? Healthy seems to be todays-date-minus-8: like if today is 2025-03-10 then I expect no trash folders older than 2025-03-02 (and if there were any, they can just be deleted).
Like havri1 had folders from 2024. If you have a massive amount of trash: look for orphan folders like that you can just delete.
It’s normal to loose dashboard stats… because you just deleted the databases that have those stats.
Just delete them and let the walkers finish. The only thing you can keep an eye on in the dashboard is status online/offline.
Don’t restore db-es from backups. They can hold wrong data. All the db-es are recreated by the node with the help of the walkers.
The badger cache was set up based on support’s recommendation, I deleted all databases, and restarted the node. Additionally, a new item was added to the configuration:
run garbage collection and used-space calculation filewalkers as a separate subprocess with lower IO priority (default true)
pieces.enable-lazy-filewalker: false
optional type of file stat cache. Might be useful for slow disk and limited memory. Available options: badger (EXPERIMENTAL)
pieces.file-stat-cache: badger
The trash seems to have been restored. My statistics haven’t been restored even after a day, I’m curious if I’ll get everything back.
I think you need to see if the file walker is still running. Search the log for:
used-space-filewalker
No, it was turned off. So that was the problem. I turned it on and restarted the node. Waiting for updates, thank you!