Disk usage discrepancy?

[Toyoo]

@Mad_Max

But Storj, written by a group of professional (presumably) programmers, for some reason makes it almost 100 times slower at the same time with a constant almost 100% disk load.

Patches are welcome.

@snorkel

I’m curious if this applies to Linux/ext4 fs too, because it’s painful slow there too, but verry dependent on RAM. In 1GB system, it tooks like a day per TB, in higher RAM systems it tooks like an hour per TB, but still it’s verry slow compared to your findings.

We know that on Linux it’s going “fast” if metadata fits in RAM, and “slow” otherwise, with the threshold depending on the settings of file system used. I managed to optimize my nodes so that the file walker takes around 8 minutes per terabyte of pieces in the “fast” scenario, and I found it good enough for myself. This was discussed on the forum many, many times, with so far nobody taking the challenge to writing reliable code to improve the situation. Maybe Mad_Max will take this challenge?