Monthly updated new node report

Node Operators
61

I believe you both right - the gc-filewalker runs max about 6h total (in my case) for 9TB of total space once a week and the used-space-filewalker every restart (about 3d 17h in a worst case).
But it depends on chosen FS, OS and amount of free memory.

2 Likes
62

Only every restart? Or is there also some time interval?

63

He is only testing on ext4, so probably dbs are cached anyway. afaik.

64

Accordingly logs only after start.

$ zcat /mnt/x/storagenode2/storagenode.log-20240101.gz | grep Node
2023-12-04T23:47:11Z    INFO    Node 1Hhxxx started {"process": "storagenode"}
2023-12-16T01:17:11Z    INFO    Node 1Hhxxx started {"process": "storagenode"}

$ zcat /mnt/x/storagenode2/storagenode.log-20240101.gz | grep "used-space-filewalker" | grep -E "started|finished" | grep 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S
2023-12-05T05:03:34Z    INFO    lazyfilewalker.used-space-filewalker    subprocess started      {"process": "storagenode", "satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"}
2023-12-05T05:03:34Z    INFO    lazyfilewalker.used-space-filewalker.subprocess Database started        {"process": "storagenode", "satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "process": "storagenode"}
2023-12-05T05:03:34Z    INFO    lazyfilewalker.used-space-filewalker.subprocess used-space-filewalker started   {"process": "storagenode", "satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "process": "storagenode"}
2023-12-07T10:05:35Z    INFO    lazyfilewalker.used-space-filewalker    subprocess finished successfully        {"process": "storagenode", "satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"}
2023-12-16T10:36:13Z    INFO    lazyfilewalker.used-space-filewalker    subprocess started      {"process": "storagenode", "satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"}
2023-12-16T10:36:14Z    INFO    lazyfilewalker.used-space-filewalker.subprocess Database started        {"process": "storagenode", "satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "process": "storagenode"}
2023-12-16T10:36:14Z    INFO    lazyfilewalker.used-space-filewalker.subprocess used-space-filewalker started   {"process": "storagenode", "satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "process": "storagenode"}
2023-12-18T09:33:05Z    INFO    lazyfilewalker.used-space-filewalker    subprocess finished successfully        {"process": "storagenode", "satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"}

But it also updates a cache (databases) every hour and every successful upload. Just didn’t run the whole scan.

1 Like