I think it is everyone would dream to have it.
where did you found a balance, look more precisely.
Casually storing the entire Internet on a 6Tb drive
5 Likes
May be storj found new way how to pack it.
4 Likes
It’s all just Ones and Zeros. So you technically just need 2 bits 
2 Likes
I can compress any sized file into a single bit! The decompression app, however, is massive…
3 Likes
but there is not a lot of trash 
Imagine the file walker…
Did you enable the whole disk feature?
no, only updated first 1.114.5 then to 1.114.6 and then discovered this one, I wating now filewalker, hope it will fix problem
1 Like
I found that HDD do nothing, then desided to to check.
I havent seen faster filewalker also.
| 2024-10-10T10:34:43+03:00 | INFO | pieces | used-space-filewalker completed | {Satellite ID: 1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE, Lazy File Walker: false, Total Pieces Size: 4223652096, Total Pieces Content Size: 4218059008, Total Pieces Count: 10924, Duration: 5.2889ms} |
|---|---|---|---|---|
| 2024-10-10T10:34:43+03:00 | INFO | pieces | used-space-filewalker started | {Satellite ID: 121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6} |
| 2024-10-10T10:34:43+03:00 | INFO | pieces | used-space-filewalker completed | {Satellite ID: 121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6, Lazy File Walker: false, Total Pieces Size: 72305018368, Total Pieces Content Size: 72181949952, Total Pieces Count: 240368, Duration: 5.1732ms} |
| 2024-10-10T10:34:43+03:00 | INFO | pieces | used-space-filewalker started | {Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S} |
| 2024-10-10T10:34:43+03:00 | INFO | pieces | used-space-filewalker completed | {Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Lazy File Walker: false, Total Pieces Size: 2507846550317345774, Total Pieces Content Size: 2507846544247972334, Total Pieces Count: 11854245, Duration: 6.7543ms} |
| 2024-10-10T10:34:43+03:00 | INFO | pieces | used-space-filewalker started | {Satellite ID: 12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs} |
| 2024-10-10T10:34:43+03:00 | INFO | pieces:trash | emptying trash finished | {Satellite ID: 12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs, elapsed: 20.2668ms} |
| 2024-10-10T10:34:43+03:00 | INFO | pieces:trash | emptying trash started | {Satellite ID: 121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6} |
| 2024-10-10T10:34:43+03:00 | INFO | pieces | used-space-filewalker completed | {Satellite ID: 12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs, Lazy File Walker: false, Total Pieces Size: 475537954304, Total Pieces Content Size: 475056305664, Total Pieces Count: 940720, Duration: 5.6594ms} |
I alredy deleted cache files, but it not helped.
Seems you have an issue with the filesystem. Please stop the node and check and fix the FS on the disk.
1 Like
Tested. All OK
but broblem is the same.
| 2024-10-10T12:34:43+03:00 | INFO | pieces | used-space-filewalker completed | {Satellite ID: 1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE, Lazy File Walker: false, Total Pieces Size: 4223652096, Total Pieces Content Size: 4218059008, Total Pieces Count: 10924, Duration: 176.368ms} |
|---|---|---|---|---|
| 2024-10-10T12:34:43+03:00 | INFO | pieces | used-space-filewalker started | {Satellite ID: 121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6} |
| 2024-10-10T12:34:44+03:00 | INFO | pieces | used-space-filewalker completed | {Satellite ID: 121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6, Lazy File Walker: false, Total Pieces Size: 72305018368, Total Pieces Content Size: 72181949952, Total Pieces Count: 240368, Duration: 84.3203ms} |
| 2024-10-10T12:34:44+03:00 | INFO | pieces | used-space-filewalker started | {Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S} |
| 2024-10-10T12:34:44+03:00 | INFO | pieces | used-space-filewalker completed | {Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Lazy File Walker: false, Total Pieces Size: 2507846550317345774, Total Pieces Content Size: 2507846544247972334, Total Pieces Count: 11854245, Duration: 6.618ms} |
| 2024-10-10T12:34:44+03:00 | INFO | pieces | used-space-filewalker started | {Satellite ID: 12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs} |
| 2024-10-10T12:34:44+03:00 | INFO | pieces | used-space-filewalker completed | {Satellite ID: 12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs, Lazy File Walker: false, Total Pieces Size: 475537954304, Total Pieces Content Size: 475056305664, Total Pieces Count: 940720, Duration: 91.8098ms} |
Interesting does anyone have same problem that file walker end in milliseconds?
No, unfortunately 
Maybe it’s related to the new dedicated disk feature?
1 Like
Seems they do not
I hopefully found how to fix it, looks like it was database error, as after I renamed DBs, made new, then copied all back, except 2 of them that related to space, filewalkers started to do its work, now waiting they finish. If someone from devs want to look to this DBs I can send them. May be error in Used space by prefix, for some reason I have there 4096 rows, it look like doble of should be? or event 4x? @Alexey
Could you please check the integrity of the original database?
I checked on my node,
$ docker run -it --rm --mount type=bind,source=${PWD},destination=/data sstc/sqlite3 sqlite3 used_space_per_prefix.db "select count(*) from used_space_per_prefix;"
0