I’ve just finished copying my movies and series collection from the same disk I run Storj on. Later, I’ll remove them completely. I also cleared some space and went to config.yaml file to add another terabyte of space to Storj. I got interested in some other parameters, that might make the node work better:
in-memory buffer for uploads
filestore.write-buffer-size: 512.0 KiB (I’ve increased it from 128 KiB)
file preallocated for uploading
pieces.write-prealloc-size: 16.0 MiB (I’ve increased it from 4 MiB)
how many concurrent retain requests can be processed at the same time.
retain.concurrency: 20 (I’ve increased it from 5)
Could someone explain those 3 parameters to me and how increasing them would affect the node?
filestore.write-buffer-size
Which loads your ram with data before going to the drive. Good for SMR drives.
pieces.write-prealloc-size
It preloads data before the data is there. So it will prevent anything else using the space.
how many concurrent retain requests can be processed at the same time
This is how many files can be uploaded at once before it will give an error. Normally you wouldn’t touch this because it will handle it on its own. Unless your having issues with losing the race or low powered nodes.
If your question is does it help the performance of your node in anyway. This really depends on the system that the node is running on the hard drives that are being used. If its a pretty high end system I would say no this really doesn’t do much at all keeping settings at default is usually the best bet.
I’ve also stopped the node right now and started defragmentation. The orders.db file has over 13k fragments scatted on the whole disk - it’s madness. And 2 MB files have over 500 fragments. No wonder it’s working slow.
At some point I couldn’t watch a movie or episode without lag from disk read. That’s when I started to copy everything to internal drives. When I’ll buy a new external disk to have a second copy, then this 6TB drive will be for Storj only.
Yeah I can imagine. SMR have good read but if any write is happening a the same time say goodbye to any performance of it. I to had SMR drives I upgraded to CMR drives.
Well, I bought the drive before joining Storj, so I did not know, that SMR is a problem. If I’ll buy any more drives for Storj, then I’ll take a closer look at this aspect.