Tuning the filewalker

No, it isn’t. This blanket statement is false.

If customers want to store millions of small files — you will end up with millions of small files. You can’t control what customers do. (And no, bunching small files into big blobs is counterproductive, it will just move a problem to random access inside a blob, but this time without benefiting from metadata caching.

This file-walker problem is a made up issue. Just don’t run a storage node that you expect to serve terabytes of data on a potato. As I said above, I felt no effects of file walker on my nas. None. I learned about it from the forum. Properly configured filesystem can handle millions and billions of files.

1 Like