# Updates on Test Data **URL:** \ **Category:** Announcements\ **Created:** [April 30, 2024, 3:36pm UTC](https://forum.storj.io/t/updates-on-test-data/26034 "2024-04-30T15:36:45Z")\ **Posts on this page:** 20\ **Page:** 34
**Author:** ![Pentium100](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/pentium100/32/6082_2.png) [@Pentium100](https://forum.storj.io/u/Pentium100)\ **Post date:** [June 4, 2024, 7:35pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/749 "2024-06-04T19:35:45Z")
How much traffic are you getting now? My single node currently gets around 240mbps. ---
**Author:** ![BrightSilence](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/brightsilence/32/6048_2.png) [@BrightSilence](https://forum.storj.io/u/BrightSilence)\ **Post date:** [June 4, 2024, 7:47pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/750 "2024-06-04T19:47:54Z")
> [@littleskunk](#): > > choiceofn with n=6 has broken a new record and was about 20% faster than we would need. For some reason not for long. The performance decreased. We will now run with a bit less load for a longer time to see if it is stable. > > How does it look on your side? Do you see any issues why the performance might decrease? Could it not just be that choice of 6 underutilizes slower nodes over time? This is my overview of todays tests so far. But shortly after the largest peaks 4 out of 6 IP’s filled up all space. So I’m now working with only 2 with free space. ![image](https://storj-s3.bcdn.literatehosting.net/original/3X/c/3/c334b0e0339f0a5fa43d7d56da6bef5c6b1e6e46.png) SSD Cache is also saturated again. Doesn’t seem to make me fail many races though. System seems to quite easily manage, though some things in the DSM web UI are getting a little slow. Nothing I can’t handle though. ---
**Author:** ![Toyoo](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/toyoo/32/1126_2.png) [@Toyoo](https://forum.storj.io/u/Toyoo)\ **Post date:** [June 4, 2024, 7:56pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/751 "2024-06-04T19:56:29Z")
> [@littleskunk](#): > > Remove 20% of the nodes from the node selection and check how that impacts performance. Don’t worry we will add them back a few minutes later. So, k=20000. Close enough 😛 > [@littleskunk](#): > > Verify how good our node selection is. It feels a bit like picking random numbers and measure throughput without understanding how the actual distribution looks like. I tell you, automate this with hyperopt (or a similar tool). > [@pangolin](#): > > Any ideas how to reject uploads based on TTL? 🤔 Sth like: ``` if !limit.PieceExpiration.IsZero() { time.Sleep(30 * time.Seconds) } ``` put in the right place in the code will do. It will affect the number of non-TTL uploads though, and you’ll be breaking the T&C. > [@Roxor](#): > > (but… if your node magically lost every race to accept TTL data… I don’t see how Storj would know if that was intentional or accidental… you’d just make less money) Pretty easy to check if you know what to look for. > [@striker43](#): > > Nice to hear that! Can you tell us more precisely what the goal is? How much bandwidth is the target? I kind of think they’ll put the results into marketing resources soon anyway. ---
**Author:** ![littleskunk](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/littleskunk/32/63_2.png) [@littleskunk](https://forum.storj.io/u/littleskunk)\ **Post date:** [June 4, 2024, 8:13pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/752 "2024-06-04T20:13:02Z")
Final test for today is the lowest long tail I feel comfortable with `16/20/30/33` Hopefully choiceofn with n= 6 can remove enough bad nodes to make this work. It might be a bit too aggressive. ---
**Author:** ![snorkel](https://storj.bcdn.literatehosting.com/letter_avatar/snorkel/32/5_5575768a8748004e209b776fc1b2916d.png) [@snorkel](https://forum.storj.io/u/snorkel)\ **Post date:** [June 4, 2024, 8:21pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/754 "2024-06-04T20:21:59Z")
Maybe a report on Medium or some blog site, to promote Storj more. ---
**Author:** ![daki82](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/daki82/32/1128_2.png) [@daki82](https://forum.storj.io/u/daki82)\ **Post date:** [June 4, 2024, 8:29pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/755 "2024-06-04T20:29:08Z")
> [@littleskunk](#): > > What I don’t understand is why the unvetted nodes have such an impact keep in mind the incubated mini-nodes? ---
**Author:** ![ACarneiro](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/acarneiro/32/1129_2.png) [@ACarneiro](https://forum.storj.io/u/ACarneiro)\ **Post date:** [June 4, 2024, 8:32pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/757 "2024-06-04T20:32:17Z")
> [@daki82](#): > > keep in mind the incubated mini-nodes? “Incubator” nodes are vetted, small and full. Those shouldn’t really make a difference. ---
**Author:** ![snorkel](https://storj.bcdn.literatehosting.com/letter_avatar/snorkel/32/5_5575768a8748004e209b776fc1b2916d.png) [@snorkel](https://forum.storj.io/u/snorkel)\ **Post date:** [June 4, 2024, 8:32pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/758 "2024-06-04T20:32:40Z")
Damn… so huge ingress on my 6 month old node, sharing the same IP with my 3.5 years old node that quited SL sat. The old guy has 8.5TB down from 14.5, but the new guy recovered all the loses with these tests. ![IMG_6617](https://storj-s3.bcdn.literatehosting.net/original/3X/c/c/cc529dafa7f4e7be5b311f583364892ffc16a2a3.jpeg) ---
**Author:** ![snorkel](https://storj.bcdn.literatehosting.com/letter_avatar/snorkel/32/5_5575768a8748004e209b776fc1b2916d.png) [@snorkel](https://forum.storj.io/u/snorkel)\ **Post date:** [June 4, 2024, 8:34pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/759 "2024-06-04T20:34:18Z")
I have to prepare for new upgrades next year, if this trend continuus. ---
**Author:** ![pangolin](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/pangolin/32/15685_2.png) [@pangolin](https://forum.storj.io/u/pangolin)\ **Post date:** [June 4, 2024, 8:36pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/760 "2024-06-04T20:36:12Z")
Unvetted nodes are probably faster than average. I mean we are talking about patato nodes all the time. Also disks are not yet fragmented and not much filewalkers running. So no surprice to me. ---
**Author:** ![littleskunk](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/littleskunk/32/63_2.png) [@littleskunk](https://forum.storj.io/u/littleskunk)\ **Post date:** [June 4, 2024, 8:37pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/761 "2024-06-04T20:37:38Z")
> [@pangolin](#): > > So no surprice to me. You are using that term too often. How about you just tell us what to change next? 😃 ---
**Author:** ![ACarneiro](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/acarneiro/32/1129_2.png) [@ACarneiro](https://forum.storj.io/u/ACarneiro)\ **Post date:** [June 4, 2024, 8:39pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/762 "2024-06-04T20:39:20Z")
> [@littleskunk](#): > > tell us what to change next? Dial the speed selector up to 11. That should make us sweat ;)) ---
**Author:** ![daki82](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/daki82/32/1128_2.png) [@daki82](https://forum.storj.io/u/daki82)\ **Post date:** [June 4, 2024, 8:41pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/763 "2024-06-04T20:41:50Z")
> [@ACarneiro](#): > > “Incubator” nodes are vetted, small and full full like my 10TB node freed up half its space? or full again? ---
**Author:** ![littleskunk](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/littleskunk/32/63_2.png) [@littleskunk](https://forum.storj.io/u/littleskunk)\ **Post date:** [June 4, 2024, 8:44pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/764 "2024-06-04T20:44:13Z")
`16/20/30/33` was too low. I could see on my own node that it was more bumpy as if every now and than it hits more than 3 slower nodes and can’t get to maximum throughput. Well now we know. Lets try this again with `16/20/30/35` to see if 2 more nodes are enough. ---
**Author:** ![ACarneiro](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/acarneiro/32/1129_2.png) [@ACarneiro](https://forum.storj.io/u/ACarneiro)\ **Post date:** [June 4, 2024, 9:00pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/765 "2024-06-04T21:00:28Z")
Well, the typical “incubator node” is 500GB, has been running for a few months and is now full. The idea of them is to have a few small nodes which have been pre-vetted so that when your main nodes are getting full you just transfer those small ones across onto a large HDD and that way you don’t have to wait for the whole vetting process to happen. ---
**Author:** ![daki82](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/daki82/32/1128_2.png) [@daki82](https://forum.storj.io/u/daki82)\ **Post date:** [June 4, 2024, 9:10pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/766 "2024-06-04T21:10:38Z")
what if there are many new, unvetted, and half full of them? ---
**Author:** ![Ruskiem](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/ruskiem/32/64_2.png) [@Ruskiem](https://forum.storj.io/u/Ruskiem)\ **Post date:** [June 4, 2024, 9:12pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/767 "2024-06-04T21:12:09Z")
TL;DR: because unvetted nodes belong mostly to serious SNOs with serious networks. with IP limit OFF, they suddenly joined and inflate the test result. probbaly because only significant SNOs, who already have xx or xxx nodes vetted from long time, does incubate spare nodes, just in case. Those operators has serious equipment and networks, this, with combination of net /24 ip rule suspended, uncovered theirs network potential, and that great majority of unvetted is connected to good networks. And that, the only biggest players think about making new nodes, to secure theirs existing operation or to expand. If only as a spare nodes - then the question is why they worry? Not so easy to loose a node, You have to be offline 30 days. Sure, You run say: 200 nodes, and You loose some, You want to have spare nodes. But if You have 200 and You run 200 spare with minimal HDD space, i would question that. For me its proooobably because those xx or xxx or maybe xxxx nodes are run from same location, just on different ip. Thats why they are so afraid if something happens, all nodes are cooked, so have to run a lot of spare as well. To me, it says that no new nodes from outsiders. i conclude pay rate isn’t encouraging. Not an offtopic, just Another argument for if You want more space to be added, and importantly, from new people, NEW ppl to join, maybe You could consider to share with us, SNOs a little bit more. if You face need of rapid growth, isn’t it better to think about it earlier? There, my stance sits still, a 2,5$/TB/storage is fair! And how wonderful! You can use results of this test to conclude how to adjust the reed solomon to meet the numbers, so everyone are happy! Long live the Storj! so You just discovered most of unvetted nodes are spare parts for most serious SNOs, mostly with Online nodes circumventing Your net /24 rule. (or they couldn’t be doing this seriously) Now If You have a lot of Nodes with same IP, but small HDD, now, most likely You got real IP of those guys. Or at least main IP. Without VPN. No one sane would keep 10-20+ nodes on same IP, even 3-4 neighbors gives no gains, i got such 1 node, but i do nothing yet, but i will. If You do xx-xxxx nodes = You do it for profit, and seriously. And You have to have 1 IP per 1 HDD or it makes no sense. Not sure if i want add more atm, tho i will play pangolin with “no surprise to me”. And in case what to change? idk depends if thats realy a problem, from throughput stance of course. Other than throughput i dont wanna start offtopic, and that’s where I’ll stop. ---
**Author:** ![littleskunk](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/littleskunk/32/63_2.png) [@littleskunk](https://forum.storj.io/u/littleskunk)\ **Post date:** [June 4, 2024, 9:16pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/768 "2024-06-04T21:16:08Z")
Ok looks like we need to stay at `16/20/30/38` because anything lower than that is getting too slow. We are finishing our tests for today and will run it over night on a lower total throughput. ---
**Author:** ![Doddophonique](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/doddophonique/32/70_2.png) [@Doddophonique](https://forum.storj.io/u/Doddophonique)\ **Post date:** [June 4, 2024, 9:56pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/769 "2024-06-04T21:56:33Z")
This test really made me wish I had more bandwidth 😁 very happy with the results though, only lost more or less a couple % points in succesful uploads during the last 24h. Makes me wonder how this setup would cope with a higher bandwidth ![image](https://storj-s3.bcdn.literatehosting.net/original/3X/e/5/e579dc26528b2be6488fa28ba49e1434d1085ef4.png) ---
**Author:** ![KernelPanick](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/kernelpanick/32/62_2.png) [@KernelPanick](https://forum.storj.io/u/KernelPanick)\ **Post date:** [June 4, 2024, 11:48pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/770 "2024-06-04T23:48:35Z")
3 shared nodes getting about 200Mbps, 40-50% CPU, 10% disk IO pressure, no netdata alerts [Previous page](https://forum.storj.io/t/updates-on-test-data/26034.md?page=33) [Next page](https://forum.storj.io/t/updates-on-test-data/26034.md?page=35)