I’m currently expanding my RAID6 array and noticed the CPU couldn’t keep up with the background expansion operation and three storj nodes , even setting the expansion task to low: [a35963bb-c2cb-463d-9a0c-e5527f4a6d3e] Note: 6 CPU cores, 12 threads I’ve managed to have just one node running but …

there is an option in storj / storagenodes to move the database to another location, since you are running a mirror Boot / OS solution it would make good sense and be perfectly safe to move the databases of your storagenodes to this location and thus potentially save a lot of IO that is difficult fo…

No idea about CPU usage or iowait, but… [image] cml: The nodes I have on this machine are turned off because it is preferable I end the expansion and have data availability than by being suspended/DQ because I failed audits in acceptable time due to the iowait. Some compromise could be runni…

Being offline will not cause failed audits. DQ for downtime currently requires around 2 weeks (I think, someone should confirm this as it recently changed). However, why not just let everything take a little longer but stay online? Whenever I rebuild an array that StorJ is stored on, it does take …

Why are you running more then one node on the same array anyway? You will not getting more data compared to one node.

Aren’t nodes limited to 20TB ?

no that is just a recommended size. Depending on the ingress and the deletion ratio it might take 1 or more years to fill up, so more than 20TB doesn’t really make sense to have at the start. You can however expand it to any size you like.

64kbit stripe size maybe a bit small… but most likely not worth the effort to change it… nor can i tell you that you will for sure benefit from that… you will have to get some benchmarks on that, also depends on where you database is located, how many RAM you system has and if you are using any lar…

@SGC thanks for the comprehensive reply. I’m using an Adaptec ASR72405 RAID adapter, and 48 GB of RAM. The OS is working on a Soft RAID 1 with 2x 256GB SSDs. I will add two SSDs to the array and see if their maxCache solution help, I haven’t thought on it honestly as I’m already using the RAID ada…

That’s a good idea, will try it, tks :wink:

@SGC suggestion worked wonders. Now I get 0~5% iowait after some initial garbage collection where I got 5~15%.

2 weeks cumulative? So during the entire lifespan of the node? Or two weeks every 6 months for example?

RAID6 array expansion and Storj

Node Operators

Alexey October 26, 2020, 7:02am 13