Filewalker not running when disabling lazyfilewalker

Blockquote
Looks like this was deployed with v1.105.2. Any outstanding actions here @profclems ?

So instead of battling with me on forums you could say that this has been resolved in upcoming release, like an proffesional.

1 Like

So lets go back to the original question. I am not aware of any problems. The ticket you linked was fixed in 104. I did communicate that here: Release preparation v1.104 - #2 by littleskunk

Can you maybe stop blaming me? This is very toxic!

2 Likes

The issue is resolved in 1.105.2 according to that github link. And again please work on your attitude when representing storj.

1 Like

I am sure the fix was part of 104. Best way to verify that is tracking down the fix that is linked in the github ticket and check if it shows up in the change log of the 104 release. I already linked the corresponding changelog so that you don’t have to track it down yourself.

In any case I tested this on all of my nodes and they did update the trash size. So I still don’t know what the issue could be. I will take a look at the ticket your created and respond to that later.

I am willing to keep this professional even if you keep making it toxic. There isn’t much more I can do.

Alright great thanks littleskunk! i have i think around 10-12 nodes on 1.104.5 which is not updating the trash data. I can enable the logging again on two of these what information do you need from me so we can resolve the root cause?

@littleskunk

C:\Program Files\Storj\Storage Node\storagenode.log:7461:2024-06-19T20:11:25+02:00      INFO    lazyfilewalker.used-space-filewalker    subprocess started      {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFz
osMuawymB"}
C:\Program Files\Storj\Storage Node\storagenode.log:7462:2024-06-19T20:11:25+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker subprocess started      {"satelliteID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiX
pmZWKwmcNDDs"}
C:\Program Files\Storj\Storage Node\storagenode.log:7463:2024-06-19T20:11:25+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker.subprocess      trash-filewalker started        {"satelliteID": "12L9ZFwhzVpuEKMUNUqkaT
LGzwY9G24tbiigLiXpmZWKwmcNDDs", "Process": "storagenode", "dateBefore": "2024-06-12T20:11:25+02:00"}
C:\Program Files\Storj\Storage Node\storagenode.log:7464:2024-06-19T20:11:25+02:00      INFO    lazyfilewalker.used-space-filewalker.subprocess Database started        {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHV
EzJubnzFzosMuawymB", "Process": "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:7465:2024-06-19T20:11:25+02:00      INFO    lazyfilewalker.used-space-filewalker.subprocess used-space-filewalker started   {"satelliteID": "12rfG3sh9NCWiX3ivPjq
2HtdLmbqCrvHVEzJubnzFzosMuawymB", "Process": "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:7466:2024-06-19T20:11:26+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker.subprocess      Database started        {"satelliteID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G2
4tbiigLiXpmZWKwmcNDDs", "Process": "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:7471:2024-06-19T20:11:26+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker subprocess finished successfully        {"satelliteID": "12L9ZFwhzVpuEKMUNUqkaTLGz
wY9G24tbiigLiXpmZWKwmcNDDs"}
C:\Program Files\Storj\Storage Node\storagenode.log:7475:2024-06-19T20:11:26+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker subprocess started      {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSx
cs8EjT69tGE"}
C:\Program Files\Storj\Storage Node\storagenode.log:7476:2024-06-19T20:11:26+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker.subprocess      trash-filewalker started        {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf
6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Process": "storagenode", "dateBefore": "2024-06-12T20:11:26+02:00"}
C:\Program Files\Storj\Storage Node\storagenode.log:7477:2024-06-19T20:11:26+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker.subprocess      Database started        {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4E
AtmN5DpSxcs8EjT69tGE", "Process": "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:7481:2024-06-19T20:11:27+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker subprocess finished successfully        {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9
wtk4EAtmN5DpSxcs8EjT69tGE"}
C:\Program Files\Storj\Storage Node\storagenode.log:7485:2024-06-19T20:11:27+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker subprocess started      {"satelliteID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz2
1tuvgk3vzoA6"}
C:\Program Files\Storj\Storage Node\storagenode.log:7486:2024-06-19T20:11:27+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker.subprocess      trash-filewalker started        {"satelliteID": "121RTSDpyNZVcEU84Ticf2
L1ntiuUimbWgfATz21tuvgk3vzoA6", "Process": "storagenode", "dateBefore": "2024-06-12T20:11:27+02:00"}
C:\Program Files\Storj\Storage Node\storagenode.log:7487:2024-06-19T20:11:27+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker.subprocess      Database started        {"satelliteID": "121RTSDpyNZVcEU84Ticf2L1ntiuUi
mbWgfATz21tuvgk3vzoA6", "Process": "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:7489:2024-06-19T20:11:27+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker subprocess finished successfully        {"satelliteID": "121RTSDpyNZVcEU84Ticf2L1n
tiuUimbWgfATz21tuvgk3vzoA6"}
C:\Program Files\Storj\Storage Node\storagenode.log:7493:2024-06-19T20:11:27+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker subprocess started      {"satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrs
LZHeLUtdps3S"}
C:\Program Files\Storj\Storage Node\storagenode.log:7494:2024-06-19T20:11:27+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker.subprocess      trash-filewalker started        {"satelliteID": "12EayRS2V1kEsWESU9QMRs
eFhdxYxKicsiFmxrsLZHeLUtdps3S", "dateBefore": "2024-06-12T20:11:27+02:00", "Process": "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:7495:2024-06-19T20:11:27+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker.subprocess      Database started        {"satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxK
icsiFmxrsLZHeLUtdps3S", "Process": "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:7497:2024-06-19T20:11:27+02:00      INFO    lazyfilewalker.trash-cleanup-filewalker subprocess finished successfully        {"satelliteID": "12EayRS2V1kEsWESU9QMRseFh
dxYxKicsiFmxrsLZHeLUtdps3S"}
C:\Program Files\Storj\Storage Node\storagenode.log:7533:2024-06-19T20:11:45+02:00      INFO    lazyfilewalker.used-space-filewalker    subprocess finished successfully        {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbq
CrvHVEzJubnzFzosMuawymB"}
C:\Program Files\Storj\Storage Node\storagenode.log:7535:2024-06-19T20:11:45+02:00      INFO    lazyfilewalker.used-space-filewalker    subprocess started      {"satelliteID": "12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5
mfS2rUmo"}
C:\Program Files\Storj\Storage Node\storagenode.log:7536:2024-06-19T20:11:46+02:00      INFO    lazyfilewalker.used-space-filewalker.subprocess Database started        {"satelliteID": "12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6
aToeiwbo5mfS2rUmo", "Process": "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:7537:2024-06-19T20:11:46+02:00      INFO    lazyfilewalker.used-space-filewalker.subprocess used-space-filewalker started   {"satelliteID": "12tRQrMTWUWwzwGh18i7
Fqs67kmdhH9t6aToeiwbo5mfS2rUmo", "Process": "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:7541:2024-06-19T20:11:47+02:00      INFO    lazyfilewalker.used-space-filewalker    subprocess finished successfully        {"satelliteID": "12tRQrMTWUWwzwGh18i7Fqs67kmd
hH9t6aToeiwbo5mfS2rUmo"}
C:\Program Files\Storj\Storage Node\storagenode.log:7543:2024-06-19T20:11:47+02:00      INFO    lazyfilewalker.used-space-filewalker    subprocess started      {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8
EjT69tGE"}
C:\Program Files\Storj\Storage Node\storagenode.log:7544:2024-06-19T20:11:47+02:00      INFO    lazyfilewalker.used-space-filewalker.subprocess Database started        {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtm
N5DpSxcs8EjT69tGE", "Process": "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:7545:2024-06-19T20:11:47+02:00      INFO    lazyfilewalker.used-space-filewalker.subprocess used-space-filewalker started   {"satelliteID": "1wFTAgs9DP5RSnCqKV1e
Lf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Process": "storagenode"}


image

Thank you for the logs. I am missing:

2024-06-19T18:35:07+02:00       INFO    lazyfilewalker.used-space-filewalker.subprocess used-space-filewalker completed {"Process": "storagenode", "satelliteID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6", "Process": "storagenode", "piecesTotal": 93281101568, "piecesContentSize": 93151683328}

Do you have that in your logs?

1 Like

Oh I guess I see it now. The filewalker never finished running in your case. The trash cleanup job did but not the filewalker. So yea keep it running and it should update the trash size as well.

2 Likes

Yes i just turned the logging on, but how can the filewalkers be so fast on all other satellites? I remember before May us1 and eu1 would take some time but now its instantly? Is all data removed? See the timestamps from the log.

Lets wait and see for it to complete. But it feels wierd the filewalkers is so fast on EU/US.

also is it normal that piece_expiration is = 1.8 GB?

@littleskunk

I think so. All of mine are above 1GB and I think (but I am not sure) one of my nodes has it a bit larger than 32GB

1 Like

Alright thx for info.

1 Like

What makes it slow is the number of pieces. I haven’t checked the average piece size on the other satellites. I do know SLC is uploading a mix of small and medium size files. Not ideal in terms of garbage collection and filewalker runtime.

Also your filesystem and OS might do a great job caching metadata. So most other satellites might have been fast thanks to caching but because cache size is limited some might still have to hit disk.

Each upload on SLC is a new entry in that database. It will grow bigger than it was in the past. Once the TTL kicks in it should stabilize and keep the new size.

1 Like

How do I specifically check the fliewalker logs? I have a Total Disk Space Used discrepancy that is slowly getting worse and I’m wondering if there is an issue with my filewalkers. The last two times I did something to restart a Docker node that is running on Ubuntu 22, the Total Disk Space used shown on the dashboard has dropped significantly, but I think the data still exists on the drive. df -h says the drive is holding 14TB of data, but the Total Disk Space Used doughnut chart says the node is only holding ~10TB of data.

That sounds more like a file system issue. I am running ZFS with a 1M record size. Any file that is smaller than 1M would still consume 1M on the file system (unless I enable compression which I did ofc). Now this would give me a df -h output that is higher than the sum of all stored files.

1 Like

Prior to restarting the computer running the node, the Total Disk Space Used doughnut chart said my node was full with 13TB of data. After the restart it dropped to 10TB of data with 3TB listed as free. I understand the OS and node dashboard won’t completely agree. I’m concerned about the abrupt change in the amount of data my node thinks it’s storing, even though it looks like the data may still be on the drive. My data drive is formatted as ext4.

C:\Program Files\Storj\Storage Node\storagenode.log:13228:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.gc-filewalker    s
ubprocess started       {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE"}
C:\Program Files\Storj\Storage Node\storagenode.log:13230:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.used-space-file
walker  subprocess started      {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB"}
C:\Program Files\Storj\Storage Node\storagenode.log:13231:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.trash-cleanup-f
ilewalker       subprocess started      {"satelliteID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs"}
C:\Program Files\Storj\Storage Node\storagenode.log:13232:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.gc-filewalker    s
ubprocess started       {"satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"}
C:\Program Files\Storj\Storage Node\storagenode.log:13233:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.trash-cleanup-f
ilewalker.subprocess    trash-filewalker started        {"satelliteID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "P
rocess": "storagenode", "dateBefore": "2024-06-06T13:43:16+02:00"}
C:\Program Files\Storj\Storage Node\storagenode.log:13234:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.used-space-file
walker.subprocess       Database started        {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB", "Process": "s
toragenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:13235:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.used-space-file
walker.subprocess       used-space-filewalker started   {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB",
"Process": "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:13236:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.trash-cleanup-f
ilewalker.subprocess    Database started        {"satelliteID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Process":
 "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:13238:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.trash-cleanup-f
ilewalker       subprocess finished successfully        {"satelliteID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs"}
C:\Program Files\Storj\Storage Node\storagenode.log:13242:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.trash-cleanup-f
ilewalker       subprocess started      {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE"}
C:\Program Files\Storj\Storage Node\storagenode.log:13243:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.gc-filewalker.s
ubprocess       Database started        {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Process": "storagenod
e"}
C:\Program Files\Storj\Storage Node\storagenode.log:13244:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.gc-filewalker.s
ubprocess       Database started        {"satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Process": "storageno
de"}
C:\Program Files\Storj\Storage Node\storagenode.log:13245:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.gc-filewalker.s
ubprocess       gc-filewalker started   {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Process": "stora
genode", "createdBefore": "2024-05-27T19:49:10+02:00", "bloomFilterSize": 960840}
C:\Program Files\Storj\Storage Node\storagenode.log:13246:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.gc-filewalker.s
ubprocess       gc-filewalker started   {"satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Process": "stor
agenode", "createdBefore": "2024-05-28T19:59:59+02:00", "bloomFilterSize": 9058205}
C:\Program Files\Storj\Storage Node\storagenode.log:13247:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.trash-cleanup-f
ilewalker.subprocess    trash-filewalker started        {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Pr
ocess": "storagenode", "dateBefore": "2024-06-06T13:43:16+02:00"}
C:\Program Files\Storj\Storage Node\storagenode.log:13248:2024-06-13T13:43:16+02:00     INFO    lazyfilewalker.trash-cleanup-f
ilewalker.subprocess    Database started        {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Process":
"storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:13250:2024-06-13T13:43:17+02:00     INFO    lazyfilewalker.trash-cleanup-f
ilewalker       subprocess finished successfully        {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE"}
C:\Program Files\Storj\Storage Node\storagenode.log:13254:2024-06-13T13:43:17+02:00     INFO    lazyfilewalker.trash-cleanup-f
ilewalker       subprocess started      {"satelliteID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6"}
C:\Program Files\Storj\Storage Node\storagenode.log:13255:2024-06-13T13:43:17+02:00     INFO    lazyfilewalker.trash-cleanup-f
ilewalker.subprocess    trash-filewalker started        {"satelliteID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6", "P
rocess": "storagenode", "dateBefore": "2024-06-06T13:43:17+02:00"}
C:\Program Files\Storj\Storage Node\storagenode.log:13256:2024-06-13T13:43:17+02:00     INFO    lazyfilewalker.trash-cleanup-f
ilewalker.subprocess    Database started        {"satelliteID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6", "Process":
 "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:13258:2024-06-13T13:43:18+02:00     INFO    lazyfilewalker.trash-cleanup-f
ilewalker       subprocess finished successfully        {"satelliteID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6"}
C:\Program Files\Storj\Storage Node\storagenode.log:13262:2024-06-13T13:43:18+02:00     INFO    lazyfilewalker.trash-cleanup-f
ilewalker       subprocess started      {"satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"}
C:\Program Files\Storj\Storage Node\storagenode.log:13263:2024-06-13T13:43:18+02:00     INFO    lazyfilewalker.trash-cleanup-f
ilewalker.subprocess    trash-filewalker started        {"satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "d
ateBefore": "2024-06-06T13:43:18+02:00", "Process": "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:13264:2024-06-13T13:43:18+02:00     INFO    lazyfilewalker.trash-cleanup-f
ilewalker.subprocess    Database started        {"satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Process":
 "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:1589857:2024-06-14T10:51:47+02:00   INFO    lazyfilewalker.used-space-fi
lewalker        subprocess finished successfully        {"satelliteID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB"}
C:\Program Files\Storj\Storage Node\storagenode.log:1589859:2024-06-14T10:51:47+02:00   INFO    lazyfilewalker.used-space-fi
lewalker        subprocess started      {"satelliteID": "12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo"}
C:\Program Files\Storj\Storage Node\storagenode.log:1589893:2024-06-14T10:51:49+02:00   INFO    lazyfilewalker.used-space-fi
lewalker.subprocess     Database started        {"satelliteID": "12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo", "Process": "
storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:1589894:2024-06-14T10:51:49+02:00   INFO    lazyfilewalker.used-space-fi
lewalker.subprocess     used-space-filewalker started   {"satelliteID": "12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo",
 "Process": "storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:1608744:2024-06-14T11:14:31+02:00   INFO    lazyfilewalker.used-space-fi
lewalker        subprocess finished successfully        {"satelliteID": "12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo"}
C:\Program Files\Storj\Storage Node\storagenode.log:1608746:2024-06-14T11:14:31+02:00   INFO    lazyfilewalker.used-space-fi
lewalker        subprocess started      {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE"}
C:\Program Files\Storj\Storage Node\storagenode.log:1608747:2024-06-14T11:14:31+02:00   INFO    lazyfilewalker.used-space-fi
lewalker.subprocess     Database started        {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Process": "
storagenode"}
C:\Program Files\Storj\Storage Node\storagenode.log:1608748:2024-06-14T11:14:31+02:00   INFO    lazyfilewalker.used-space-fi
lewalker.subprocess     used-space-filewalker started   {"satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE",
 "Process": "storagenode"}

look at the last row, am i the only one having forever filewalker for saltlake satellite?

I would suggest to use df --si instead of df -h, because the storagenode’s dashboard uses SI measure units, not binary.

It can take days to finish. It should need to finish only once and from there on you can disable the used space filewalker and if we are lucky the numbers will stay correct over months.

@littleskunk

It would be great if you could implement a code update that would make it impossible for a node to recieve ingress if the OS is reporting less than 100gb or some value. That way nodes would not fill to the brink even tough the filewalkers is having issues. Is this something you could do?

2 Likes

As far as I understand we have that and the value is 5GB.
I do not agree to the suggestion to increase this to 100GB.
If the filewalkers have issues them should be fixed.

2 Likes