Hey everyone,
I have unraid array with 1-parity + 5x 8tb disks.
Current I am running 2 nodes, but as soon as they are almost filled, the plan was to expand and have it in all 5 disks, so 5 nodes in total eventually.
Today, I woke up with a very crazy idea, please follow my dream:
First context: From the 5 disks, I only have 20TB of data. This data is movies (accesible by my plex) and photos. For the sake of this explanation, let’s assume it is all from my camera, so I control and I input all data. So as you can see I have lots of free space.
My plan:
- Kill the array totally and will not use it any longer.
- I will create 6x cache pools with just a single disk inside.
- Each disk will run one Storj node with 3TB availability, so i will have 6 disks running at all time with 6 nodes. (that is the target).
How about my data and redundancy?
Since I control my data and the way the data is stored, I will create a 3 main folders and i will split my data cross this 3 folders. The goal is to have the 3 folder where each one will have ~5TB data allowance.
Then I will have a rsync script that will just backup the data from disk1 to disk2.
Results/Goal breakdown:
Disk1:
Node1 with 3TB
MyDataFolder1 with 5TB or less, does not matter, 5TB is the limit
Disk2:
Node2 with 3TB
MyDataFolder1 BACKUP
Disk3:
Node3 with 3TB
MyDataFolder2 with 5TB or less, does not matter, 5TB is the limit
Disk4:
Node4 with 3TB
MyDataFolder2 BACKUP
Disk5:
Node5 with 3TB
MyDataFolder3 with 5TB or less, does not matter, 5TB is the limit
Disk6:
Node6 with 3TB
MyDataFolder3 BACKUP
Conclusion: I will have 6x Nodes running 3TB each, and I will have 3 folders where I can organize myself and still have 15TB with one disk redundancy!
How crazy is that?
The main reason here is:
- Multiple nodes, to provide redundancy, in case one disk dies, I will have the other nodes, I believe this is Storj way of doing this.
- unraid array, the parity is a dead disk that is just spinning all time and bottleneck everything.
- My data is not growing, I have the same 10-12TB for long time now. In case I need more data, I can always add one more disk or kill one of the nodes.
Any thoughts on this?
Sorry for the long text, but I had to share with someone.