After having to correct an error on my system, which included deleting the .db files, the system no longer represents this amount and has started from 0, but slowly increasing (at 105GB now, from about 10 hours ago)
How long will it take my Total Disk Space / Used data to return to its previous amount? (which was somewhere around 14TB)?
It really depends because it’s not like mining, the data is from customers. You can’t really know.
I do not understand. Is the link to the data lost? Is the data lost? Can I / do I need to delete the data from the HDD? Is it just rebuilding the links to the existing data on my drive?
You need to wait from here on now. Imagine a book, where the index was torn out. You would have to read each page to find each chapter. The same thing applies to your node. You needed to remove the db-files to get it working again, consequence is that each file needs to be read in order to understand space used. I might be wrong here, but I believe it works this way.
You mentioned it used about 14 TB, so - based on some experience - I think it will take about 28 to 35 days for it to reach that. I’m gladly proven wrong.
If you have an SSD in your system, you might want to consider moving the db to the SSD. You can find some guides here on the forum.
Patience from here on 
Your data is not lost. The process that rescans the existing data will likely need some days to finish. On slow HDDs it could be even a week or more. Check the log for “used-space-filewalker” to see the progress. It needs to finish for all 4 satellites.
The time required for the filewalker is not determined, it’s highly depend on your setup and how much load it have.
Mine tooks almost 11 days to finish the scan. But it will not say you anything. Only you can figure out how much time it will take in your case. And the next time it will be different, because you likely uses the lazy filewalkers, so they calculate the space only when the disk is not busy.
That makes perfect sense. 
No worries. Was more curious about eh data being lost / starting over as it were.
Not happening, at lest not now. Is a raid array with some drives it’s running.
Ok, thanks.
Uh… I’ll wait on the progress… it’s at 185gb now… so moving along… my log is too big right now, so I’m waiting to check for “used-space-filewaker”.
What would happen if this process is stopped and restarted? (eg - the system has to be restarted)
Would it continue or would it reset / start over?
Start over. It needs to complete. Yeah, that might be tricky, especially with automatic Windows Updates
Gah. Thanks for the info.
Time to disable everything that needs disabling.
How do I know when it is completed? I’m not going to be able to reasonably open my log as it will be massive after that much reindexing work…
Anything I can look for? Lower system use? Anything in the Your Storage Node Stats web page?
Run this command in powershell:
cat "C:\Program Files\Storj\Storage Node\storagenode.log" | sls "used-space-filewalker"
If used space filewalker finished all 4 satellites result should be like this:
2024-07-11T13:54:57+02:00 INFO pieces used-space-filewalker started {"Satellite ID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE"}
2024-07-11T13:54:57+02:00 INFO lazyfilewalker.used-space-filewalker starting subprocess {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE"}
2024-07-11T13:54:57+02:00 INFO lazyfilewalker.used-space-filewalker subprocess started {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE"}
2024-07-11T13:54:57+02:00 INFO lazyfilewalker.used-space-filewalker.subprocess Database started {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Process": "storagenode"}
2024-07-12T03:00:13+02:00 INFO lazyfilewalker.used-space-filewalker subprocess finished successfully {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE"}
2024-07-12T03:00:13+02:00 INFO pieces used-space-filewalker completed {"Satellite ID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Lazy File Walker": true, "Total Pieces Size": 491276730880, "Total Pieces Content Size": 489574621696}
2024-07-12T03:00:13+02:00 INFO pieces used-space-filewalker started {"Satellite ID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6"}
2024-07-12T03:00:13+02:00 INFO lazyfilewalker.used-space-filewalker starting subprocess {"satelliteID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6"}
2024-07-12T03:00:13+02:00 INFO lazyfilewalker.used-space-filewalker subprocess started {"satelliteID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6"}
2024-07-12T03:00:13+02:00 INFO lazyfilewalker.used-space-filewalker.subprocess Database started {"satelliteID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6", "Process": "storagenode"}
2024-07-12T03:13:47+02:00 INFO lazyfilewalker.used-space-filewalker subprocess finished successfully {"satelliteID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6"}
2024-07-12T03:13:47+02:00 INFO pieces used-space-filewalker completed {"Satellite ID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6", "Lazy File Walker": true, "Total Pieces Size": 200102983168, "Total Pieces Content Size": 199699707904}
2024-07-12T03:13:47+02:00 INFO pieces used-space-filewalker started {"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"}
2024-07-12T03:13:47+02:00 INFO lazyfilewalker.used-space-filewalker starting subprocess {"satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"}
2024-07-12T03:13:47+02:00 INFO lazyfilewalker.used-space-filewalker subprocess started {"satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"}
2024-07-12T03:13:47+02:00 INFO lazyfilewalker.used-space-filewalker.subprocess Database started {"satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Process": "storagenode"}
2024-07-12T12:20:52+02:00 INFO lazyfilewalker.used-space-filewalker subprocess finished successfully {"satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"}
2024-07-12T12:20:52+02:00 INFO pieces used-space-filewalker completed {"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Lazy File Walker": true, "Total Pieces Size": 3664040816386, "Total Pieces Content Size": 3651726262018}
2024-07-12T12:20:52+02:00 INFO pieces used-space-filewalker started {"Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs"}
2024-07-12T12:20:52+02:00 INFO lazyfilewalker.used-space-filewalker starting subprocess {"satelliteID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs"}
2024-07-12T12:20:52+02:00 INFO lazyfilewalker.used-space-filewalker subprocess started {"satelliteID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs"}
2024-07-12T12:20:53+02:00 INFO lazyfilewalker.used-space-filewalker.subprocess Database started {"satelliteID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Process": "storagenode"}
2024-07-12T13:49:59+02:00 INFO lazyfilewalker.used-space-filewalker subprocess finished successfully {"satelliteID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs"}
2024-07-12T13:49:59+02:00 INFO pieces used-space-filewalker completed {"Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Lazy File Walker": true, "Total Pieces Size": 1824955184128, "Total Pieces Content Size": 1823314103296}
Aha! Thanks.
2024-07-13T13:48:06-04:00 INFO lazyfilewalker.used-space-filewalker starting subprocess {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB"}
2024-07-13T13:48:06-04:00 INFO lazyfilewalker.used-space-filewalker subprocess started {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB"}
2024-07-13T13:48:06-04:00 INFO lazyfilewalker.used-space-filewalker.subprocess Database started {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB", "Process": "storagenode"}
2024-07-13T13:48:06-04:00 INFO lazyfilewalker.used-space-filewalker.subprocess used-space-filewalker started {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB", "Process": "storagenode"}
This is a decommissioned satellite…
I ran into this as well. Used the command mentioned in the link of Pangolin, method 2.
The thing is, there was still 500GB of data present from an old satellite, making the filewalker do a lot of unnecessary scanning (waste of time).
Once started from the command line, you will not see any progress. Mine took about 30 minutes before it completed. As always, check the log where you will find an entry saying that the untrust process was completed.
Good to know. I’m not doing anything about it until this process completes.
I am again unable to access the node dashboard. Have had no internet downtime (all other nodes show continual uptime).
Command pulls the following with ERROR showing failed to start subprocess
2024-07-13T13:48:06-04:00 INFO lazyfilewalker.used-space-filewalker starting subprocess {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB"}
2024-07-13T13:48:06-04:00 INFO lazyfilewalker.used-space-filewalker subprocess started {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB"}
2024-07-13T13:48:06-04:00 INFO lazyfilewalker.used-space-filewalker.subprocess Database started {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB", "Process": "storagenode"}
2024-07-13T13:48:06-04:00 INFO lazyfilewalker.used-space-filewalker.subprocess used-space-filewalker started {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB", "Process": "storagenode"}
2024-07-13T20:28:25-04:00 INFO lazyfilewalker.used-space-filewalker.subprocess used-space-filewalker completed {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB", "piecesTotal": 198760435712, "piecesContentSize": 198674775552, "Process": "storagenode"}
2024-07-13T20:28:25-04:00 INFO lazyfilewalker.used-space-filewalker subprocess finished successfully {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB"}
2024-07-13T20:28:25-04:00 INFO lazyfilewalker.used-space-filewalker starting subprocess {"satelliteID": "12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo"}
2024-07-13T20:28:25-04:00 INFO lazyfilewalker.used-space-filewalker subprocess started {"satelliteID": "12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo"}
2024-07-13T20:28:26-04:00 INFO lazyfilewalker.used-space-filewalker.subprocess Database started {"satelliteID": "12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo", "Process": "storagenode"}
2024-07-13T20:28:26-04:00 INFO lazyfilewalker.used-space-filewalker.subprocess used-space-filewalker started {"satelliteID": "12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo", "Process": "storagenode"}
2024-07-13T21:09:01-04:00 INFO lazyfilewalker.used-space-filewalker.subprocess used-space-filewalker completed {"satelliteID": "12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo", "piecesContentSize": 6454004480, "Process": "storagenode", "piecesTotal": 6462498048}
2024-07-13T21:09:01-04:00 INFO lazyfilewalker.used-space-filewalker subprocess finished successfully {"satelliteID": "12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo"}
2024-07-13T21:09:01-04:00 INFO lazyfilewalker.used-space-filewalker starting subprocess {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE"}
2024-07-13T21:09:01-04:00 INFO lazyfilewalker.used-space-filewalker subprocess started {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE"}
2024-07-13T21:09:04-04:00 INFO lazyfilewalker.used-space-filewalker.subprocess Database started {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Process": "storagenode"}
2024-07-13T21:09:04-04:00 INFO lazyfilewalker.used-space-filewalker.subprocess used-space-filewalker started {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Process": "storagenode"}
2024-07-15T13:14:11-04:00 INFO lazyfilewalker.used-space-filewalker subprocess exited with status {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "status": 1, "error": "exit status 1"}
2024-07-15T13:14:12-04:00 INFO lazyfilewalker.used-space-filewalker starting subprocess {"satelliteID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6"}
2024-07-15T13:14:12-04:00 ERROR lazyfilewalker.used-space-filewalker failed to start subprocess {"satelliteID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6", "error": "context canceled"}
2024-07-15T13:14:12-04:00 INFO lazyfilewalker.used-space-filewalker starting subprocess {"satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"}
2024-07-15T13:14:12-04:00 ERROR lazyfilewalker.used-space-filewalker failed to start subprocess {"satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "error": "context canceled"}
2024-07-15T13:14:12-04:00 INFO lazyfilewalker.used-space-filewalker starting subprocess {"satelliteID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs"}
2024-07-15T13:14:12-04:00 ERROR lazyfilewalker.used-space-filewalker failed to start subprocess {"satelliteID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "error": "context canceled"}
The lazy filewalker is failed due to insufficient IOPS from the disk. However, it should not crash the node. But this could be also a consequence of the node crash due to other reason, like a FATAL or an Unrecoverable error.
Do you see the error like this one: Fatal Error on my Node?
