Filewalker status

Logs should be at least info level

Used space filewalker

Task: Calculates disk usage by scanning all pieces and updates the local node databases afterwards with these values

docker logs storagenode -f 2>&1 | grep "used-space-filewalker" | grep -E "started|finished"

GC filewalker

Task: Based on a Bloom filter it marks pieces as expired for removal by the retain process

docker logs storagenode -f 2>&1 | grep "gc-filewalker" | grep -E "started|finished"

Trash-cleanup filewalker

Task: Deletes pieces from trash after trash grace period

docker logs storagenode -f 2>&1 | grep "trash-cleanup-filewalker" | grep -E "started|finished"

retain

Task: Moves expired pieces to trash

docker logs storagenode -f 2>&1 | grep "retain"

collector

Task: Removes pieces that were uploaded with an expiry date without moving them to trash first

Details

Config:

# how frequently expired pieces are collected
# collector.interval: 1h0m0s
docker logs storagenode -f 2>&1 | grep "collector"

trash

docker logs storagenode -f 2>&1 | grep "pieces:trash"

How to check progress more granularly

5 Likes