The commonly called filewalker process, which is the functionality that goes over all pieces of the storage node’s blob folder seeking the metadata and looking for expired pieces, is basically smashing the spinning drives every time a node is restarted (both on manual restart and/or automatic upgrad…

[image] littleskunk: Instead I am now rejecting small file uploads. Anyone knows if this is done at a Storj Node level, firewall level, etc.? And if so how? I have one of my five nodes that would be really happy without small files. Edit: yikes, didn’t know it was against T&C.

Don’t do this. It’s against terms of service you have agreed to. Fix your node performance instead.

[image] Doddophonique: Anyone knows if this is done at a Storj Node level, firewall level, etc.? And if so how? I have one of my five nodes that would be really happy without small files. Small source code change. Against T&C, so not exactly recommended, but anyone with basic coding skills is…

How big are your trash subdirectories? These always get scanned on startup, even with disabled file walker.

Hello. I would like to raise for consideration the issue of introducing in the log file, a report, about in what state the filewalker is at the moment. (or even in SNOs dashboard if possible) Yes in log im getting starts and exit lines, but nothing in between, and monitoring it in debug mode is …

[image] Ruskiem: SAVE work done, if restart occurs, and it was not longer than few minutes ago, so it will knows, it can CONTINUE WHERE IT STOPED I requested this feature in this topic some time ago. Would be nice indeed.

You don’t need tuning, you need overhaul. [image] Ruskiem: it took windows 6-7 days to count all files. That means this storage solution you have is not suitable for running storagenode. You cannot get around physics – if touching every file takes 10ms and you need to touch millions of files…

[image] arrogantrabbit: But with windows it is possible too – just cost money and time Yes, i make my first steps with primocache. Testing new ram right now :partying_face:.

Hello together :slightly_smiling_face:, is there some guide or some possibility to check the status of the filewalker-running on some docker? I got it startet now on one of the older notes and would like to know in advance when it is complete. :slightly_smiling_face:

[image] arrogantrabbit: For reference, on a 10TB node filewalker shall not take more than 10 minutes. That’s your target. If you start with 6 days – you will never optimize it down to 10 min. Eh, I was fine with my 12 min/TB file walker on default ext4, or 8 min/TB with optimized settings, bo…