# Post pictures of your storagenode rig(s) **URL:** \ **Category:** Node Operators\ **Tags:** hardware\ **Created:** [September 3, 2019, 4:15pm UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422 "2019-09-03T16:15:16Z")\ **Posts on this page:** 20\ **Page:** 31
**Author:** ![humbfig](https://storj.bcdn.literatehosting.com/letter_avatar/humbfig/32/5_5575768a8748004e209b776fc1b2916d.png) [@humbfig](https://forum.storj.io/u/humbfig)\ **Post date:** [March 22, 2023, 5:33pm UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/645 "2023-03-22T17:33:02Z")
Of course… 🙃 I sometimes forget people have lives outside storj… Nice rig though… 👍 ---
**Author:** ![EvilMalamute](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/evilmalamute/32/1133_2.png) [@EvilMalamute](https://forum.storj.io/u/EvilMalamute)\ **Post date:** [March 23, 2023, 2:07pm UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/646 "2023-03-23T14:07:34Z")
I think using different IPs ---
**Author:** ![HGPlays](https://storj.bcdn.literatehosting.com/letter_avatar/hgplays/32/5_5575768a8748004e209b776fc1b2916d.png) [@HGPlays](https://forum.storj.io/u/HGPlays)\ **Post date:** [March 24, 2023, 12:57pm UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/647 "2023-03-24T12:57:52Z")
For anyone that wants to see my new rig: [![](https://img.youtube.com/vi/XWiWU-pVxSM/hqdefault.jpg "Storj and ScP 4TB server build. Getting ready for a new install! Small Micro ATX Server build.") ](https://www.youtube.com/watch?v=XWiWU-pVxSM) ---
**Author:** ![d4rk4](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/d4rk4/32/68_2.png) [@d4rk4](https://forum.storj.io/u/d4rk4)\ **Post date:** [March 28, 2023, 12:49pm UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/648 "2023-03-28T12:49:10Z")
200+Tb (40x SMR 5Tb HDDs) ZFS-based storage for keeping data of 4 storj nodes + personal backups space. ![IMG_9253](https://storj-s3.bcdn.literatehosting.net/original/2X/f/f766ba2f14f410c9fba1cd882a7a9dc7fc61a7f9.png) ![STRJ.PNG](https://storj-s3.bcdn.literatehosting.net/original/2X/6/6cbd4b842480e1543ffbf639c4b9342bac8d59e6.jpeg) ---
**Author:** ![HGPlays](https://storj.bcdn.literatehosting.com/letter_avatar/hgplays/32/5_5575768a8748004e209b776fc1b2916d.png) [@HGPlays](https://forum.storj.io/u/HGPlays)\ **Post date:** [March 28, 2023, 3:03pm UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/649 "2023-03-28T15:03:36Z")
Newest node - currently a 2TB disk but will be expanding when near full. Most likely migrate to a 10TB drive ![IMG_4663](https://storj-s3.bcdn.literatehosting.net/original/2X/7/74bfe8c9d9d1ffdfd64e85c4584bfe43f53d1eb4.jpeg) ---
**Author:** ![andrew2.hart](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/andrew2.hart/32/6415_2.png) [@andrew2.hart](https://forum.storj.io/u/andrew2.hart)\ **Post date:** [March 28, 2023, 6:31pm UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/650 "2023-03-28T18:31:17Z")
Wow! You really nailed that cable management! ![Screenshot_20230328-192830_Chrome](https://storj-s3.bcdn.literatehosting.net/original/2X/b/bfb45bcb01b3f82611b05d76817c6f6543326676.jpeg) P.S. Why so high up? Or is it a basement? ---
**Author:** ![snorkel](https://storj.bcdn.literatehosting.com/letter_avatar/snorkel/32/5_5575768a8748004e209b776fc1b2916d.png) [@snorkel](https://forum.storj.io/u/snorkel)\ **Post date:** [March 28, 2023, 9:12pm UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/651 "2023-03-28T21:12:43Z")
> [@HGPlays](#): > > currently a 2TB disk but will be expanding when near full. You mean in 2 months 😄 … or even quicker. ---
**Author:** ![odarriba](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/odarriba/32/1131_2.png) [@odarriba](https://forum.storj.io/u/odarriba)\ **Post date:** [March 29, 2023, 5:50am UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/652 "2023-03-29T05:50:04Z")
> [@d4rk4](#): > > ZFS-based storage How does it behave? Storj is well known for having the file walker process that checks all the small files on disk on every restart/update. It can be disabled but if you haven´t done it yet, how does the system works? I was thinking about going ZFS all the way, but ended up on different disks, one per node. ---
**Author:** ![HGPlays](https://storj.bcdn.literatehosting.com/letter_avatar/hgplays/32/5_5575768a8748004e209b776fc1b2916d.png) [@HGPlays](https://forum.storj.io/u/HGPlays)\ **Post date:** [March 29, 2023, 11:18am UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/653 "2023-03-29T11:18:35Z")
Haha yea - i could have done better! Its an a garage and needs to be out of the way 🙂 ---
**Author:** ![HGPlays](https://storj.bcdn.literatehosting.com/letter_avatar/hgplays/32/5_5575768a8748004e209b776fc1b2916d.png) [@HGPlays](https://forum.storj.io/u/HGPlays)\ **Post date:** [March 29, 2023, 11:18am UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/654 "2023-03-29T11:18:52Z")
Yea - most likely - allready 10% full ---
**Author:** ![d4rk4](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/d4rk4/32/68_2.png) [@d4rk4](https://forum.storj.io/u/d4rk4)\ **Post date:** [March 29, 2023, 12:07pm UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/655 "2023-03-29T12:07:42Z")
Working fine, but DBs placed on another ZFS pool used for VMs and backed by SAS SSDs (Zeus IOPS). I keep file-walker on all nodes because it’s not affect pool performance so much. But it will be a good idea to turn it off in the future to speed up node startup after an upgrade. You don’t get any benefits with ZFS if you use only one disk (for storj workload), try XFS instead. ---
**Author:** ![lyoth](https://storj.bcdn.literatehosting.com/letter_avatar/lyoth/32/5_5575768a8748004e209b776fc1b2916d.png) [@lyoth](https://forum.storj.io/u/lyoth)\ **Post date:** [March 29, 2023, 4:43pm UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/656 "2023-03-29T16:43:31Z")
I would not recommend ZFS for large node (4TB+). I only use ZFS for new node to vet and move them to 8TB once they hit around 4TB. I use 4x 4TB with raidz1(aka raid5). Because every write, and read it has to read from multiple harddrives in your raid, which will slow it down. Just moving my storage node out of zfs to ext4 takes at least 3-4x longer compared to ext4-\>ext4 node migration for the same amount of data. I use ext4, since ext4 generate all the inode when you format the harddrive, which I think will be sightly faster than XFS. XFS creates inode as you add files to it. ---
**Author:** ![d4rk4](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/d4rk4/32/68_2.png) [@d4rk4](https://forum.storj.io/u/d4rk4)\ **Post date:** [March 29, 2023, 10:48pm UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/657 "2023-03-29T22:48:34Z")
> [@lyoth](#): > > Because every write, and read it has to read from multiple harddrives in your raid, which will slow it down. ![image](https://storj-s3.bcdn.literatehosting.net/original/2X/5/51d86ce7ec63a68e19011f97ab4e69665fd9de79.jpeg) Did you know why system architects increased the number of spindles in storage arrays before the SSD era? P.S. ext4 also has inode limit, and it’s not increasable without reformat. ---
**Author:** ![SGC](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/sgc/32/1132_2.png) [@SGC](https://forum.storj.io/u/SGC)\ **Post date:** [March 30, 2023, 7:27am UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/658 "2023-03-30T07:27:00Z")
> [@lyoth](#): > > Just moving my storage node out of zfs to ext4 takes at least 3-4x longer compared to ext4-\>ext4 node migration for the same amount of data. use zfs send zfs recv … when you don’t exit zfs moving data to new media is like 10 to 12x faster than when using something like rsync with storj data. ---
**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\ **Post date:** [March 30, 2023, 7:46am UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/659 "2023-03-30T07:46:56Z")
Not when you want to move data zfs-\>ext4 ---
**Author:** ![SGC](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/sgc/32/1132_2.png) [@SGC](https://forum.storj.io/u/SGC)\ **Post date:** [March 30, 2023, 7:58am UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/660 "2023-03-30T07:58:03Z")
well ext4 doesn’t really need much of a manual, with zfs you can just ask it to go faster by doing zfs set sync=disabled. there are also a lot of other hardware consideration, if you have enough RAM and other activity on the media being migrated, zfs can be much faster than ext4. its not really a binary answer if one thing is faster than the other, it depends on a lot of conditions. zfs can be a bit demanding ext4 is nice simple and light weight ---
**Author:** ![agente](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/agente/32/1137_2.png) [@agente](https://forum.storj.io/u/agente)\ **Post date:** [March 30, 2023, 9:16am UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/661 "2023-03-30T09:16:40Z")
@Th3Van I’m following your project. Respect. Is it possible to share with us the success rate script that you run every hour? Is it based on ReneSmeekes or something faster and lighter? ---
**Author:** ![d4rk4](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/d4rk4/32/68_2.png) [@d4rk4](https://forum.storj.io/u/d4rk4)\ **Post date:** [March 30, 2023, 11:43am UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/662 "2023-03-30T11:43:37Z")
May you share more info about systemd units for run on bare-metal and how you update nodes? ---
**Author:** ![arrogantrabbit](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/arrogantrabbit/32/11200_2.png) [@arrogantrabbit](https://forum.storj.io/u/arrogantrabbit)\ **Post date:** [March 30, 2023, 4:39pm UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/663 "2023-03-30T16:39:26Z")
Few comments > [@SGC](#): > > well ext4 doesn’t really need much of a manual, with zfs you can just ask it to go faster by doing zfs set sync=disabled. Before disabling sync, a few less drastic measures can be taken: 1. Access Time updates can be disabled (almost halves the IO): `zfs set atime=off pool/dataset` 2. Cache metadata only: `zfs set primarycache=metadata pool/dataset` But for storagenode – indeed, turning off sync is absolutely fine. Data loss is not a problem, and you won’t have any if you got UPS in the first place. > [@SGC](#): > > ext4 is nice simple and light weight ext4 is ancient history. There are no benefits in running ext4 on the system that can support zfs, especially in a rather demanding scenarios (random access to a massive number of small files). (I remember reading interview with one of the ext4 developers years ago where they recommended to use BTRFS of ZFS for all new deployments whenever possible. Could not find it now to link here) ---
**Author:** ![Th3Van](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/th3van/32/66_2.png) [@Th3Van](https://forum.storj.io/u/Th3Van)\ **Post date:** [March 30, 2023, 8:48pm UTC](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422/664 "2023-03-30T20:48:13Z")
> [@agente](#): > > Is it possible to share with us the success rate script that you run every hour? It’s mostly based om [awk](https://manpages.ubuntu.com/manpages/trusty/man1/awk.1posix.html) I’ve made a light version of it, but the main script are custom made to my Ubuntu setup so it may or may not work, due to the time stamp format in the storagenode logfile. Link → [http://www.th3van.dk/scripts/success-rate-script-light.sh](http://www.th3van.dk/scripts/success-rate-script-light.sh) _(MD5 : 65fab5460f640b74653ae36b65a4ac3c)_😉 ```auto root@server030:/disk102/storj/logs/storagenode# time ./success-rate-script-light.sh storagenode.log ------------------------- ---------------------- PUT -------------------- ----------------- PUT_REPAIR ------------------ --------------------- GET --------------------- ----------------- GET_REPAIR ------------------ -------------- GET_AUDIT -------------- Name Date Pieces Success Rate Bytes Pieces Success Rate Bytes Pieces Success Rate Bytes Pieces Success Rate Bytes Pieces Success Rate Bytes Server stats - 2023-03-30 - 126.849/126.961 99.912 % 67.387.105.024 6.259/6.260 99.984 % 4.586.976.256 131.714/172.722 76.258 % 15.445.626.368 6.786/6.786 100.000 % 4.210.595.584 4.892/4.892 100.000 % 1.252.352 real 0m5,135s user 0m5,003s sys 0m0,132s root@server030:/disk102/storj/logs/storagenode# cat storagenode.log | wc -l 682456 ``` Th3van.dk [Previous page](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422.md?page=30) [Next page](https://forum.storj.io/t/post-pictures-of-your-storagenode-rig-s/1422.md?page=32)