# Updates on Test Data **URL:** \ **Category:** Announcements\ **Created:** [April 30, 2024, 3:36pm UTC](https://forum.storj.io/t/updates-on-test-data/26034 "2024-04-30T15:36:45Z")\ **Posts on this page:** 20\ **Page:** 37
**Author:** ![Roxor](https://storj.bcdn.literatehosting.com/letter_avatar/roxor/32/5_5575768a8748004e209b776fc1b2916d.png) [@Roxor](https://forum.storj.io/u/Roxor)\ **Post date:** [June 5, 2024, 9:49pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/819 "2024-06-05T21:49:43Z")
That’s how Storj increased MB/s… they kept the MB the same… but made the seconds take less time 🤓 ---
**Author:** ![BrightSilence](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/brightsilence/32/6048_2.png) [@BrightSilence](https://forum.storj.io/u/BrightSilence)\ **Post date:** [June 6, 2024, 7:59am UTC](https://forum.storj.io/t/updates-on-test-data/26034/820 "2024-06-06T07:59:46Z")
I’m seeing a lot of uncollected garbage pile up again as a result of this testing. ![image](https://storj-s3.bcdn.literatehosting.net/original/3X/9/d/9dada41f64f812b946ef58dd9dee890808021e2d.png) I have large GC runs ongoing now. I can think of a few reasons why this might happen. It could just be that I get to keep fewer pieces than I thought and they didn’t finish fast enough. But that seems to be a large amount if it’s just that. It could also be that some data got deleted early on the satellite end. @littleskunk could you comment on that if you know? ---
**Author:** ![Toyoo](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/toyoo/32/1126_2.png) [@Toyoo](https://forum.storj.io/u/Toyoo)\ **Post date:** [June 6, 2024, 11:45am UTC](https://forum.storj.io/t/updates-on-test-data/26034/821 "2024-06-06T11:45:47Z")
> [@BrightSilence](#): > > I have large GC runs ongoing now. I can think of a few reasons why this might happen. It could just be that I get to keep fewer pieces than I thought and they didn’t finish fast enough. But that seems to be a large amount if it’s just that. It could also be that some data got deleted early on the satellite end. @littleskunk could you comment on that if you know? Yep, noticed the same. Gave up on participating in races few days ago because of that, no value for me in it. ---
**Author:** ![Roxor](https://storj.bcdn.literatehosting.com/letter_avatar/roxor/32/5_5575768a8748004e209b776fc1b2916d.png) [@Roxor](https://forum.storj.io/u/Roxor)\ **Post date:** [June 6, 2024, 12:45pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/822 "2024-06-06T12:45:11Z")
They said deleting the forever-free data would take [several months](https://forum.storj.io/t/discontinuation-of-the-storj-free-tier/25332)… so maybe all this GC is just those small batches of deletions going through every few days? ---
**Author:** ![pangolin](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/pangolin/32/15685_2.png) [@pangolin](https://forum.storj.io/u/pangolin)\ **Post date:** [June 6, 2024, 2:05pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/823 "2024-06-06T14:05:03Z")
If this test is the new normal shouldn’t there be always like 25% of storage used for trash? I mean its 30 days TTL and once it is moved to trash it will be there for another 7 days at least. Or is TTL data not moved to trash? 🤔 ---
**Author:** ![Roxor](https://storj.bcdn.literatehosting.com/letter_avatar/roxor/32/5_5575768a8748004e209b776fc1b2916d.png) [@Roxor](https://forum.storj.io/u/Roxor)\ **Post date:** [June 6, 2024, 2:09pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/824 "2024-06-06T14:09:46Z")
> [@pangolin](#): > > Or is TTL data not moved to trash? TTL data is directly deleted: no vacation in the trash folder 🙂 ---
**Author:** ![tylkomat](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/tylkomat/32/62_2.png) [@tylkomat](https://forum.storj.io/u/tylkomat)\ **Post date:** [June 6, 2024, 2:44pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/825 "2024-06-06T14:44:10Z")
This month looks really good data wise. Although I lost contact to 4 nodes which are located in another country (burned potato :D) last month. My 3 other nodes already got 5.6 TB ingress in the last 6 days. In the past with all nodes working my maximum ingress was a little more than 4TB per month. So, good job on the Test and related updates to the storj software and satellites. ---
**Author:** ![littleskunk](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/littleskunk/32/63_2.png) [@littleskunk](https://forum.storj.io/u/littleskunk)\ **Post date:** [June 6, 2024, 2:46pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/826 "2024-06-06T14:46:55Z")
> [@BrightSilence](#): > > I have large GC runs ongoing now. I can think of a few reasons why this might happen. It could just be that I get to keep fewer pieces than I thought and they didn’t finish fast enough. But that seems to be a large amount if it’s just that. It could also be that some data got deleted early on the satellite end. @littleskunk could you comment on that if you know? Here is the fix: [https://review.dev.storj.io/c/storj/storj/+/13456](https://review.dev.storj.io/c/storj/storj/+/13456) ---
**Author:** ![BrightSilence](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/brightsilence/32/6048_2.png) [@BrightSilence](https://forum.storj.io/u/BrightSilence)\ **Post date:** [June 6, 2024, 3:02pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/827 "2024-06-06T15:02:39Z")
Just double-checking my inference. GC is catching piece within the 24 hours it takes until expiration cleans them up? This will now be reduced to 1 hour? I thought bloom filters were always based on several days old snapshots. How could it even delete data within that 24 hour period? ---
**Author:** ![littleskunk](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/littleskunk/32/63_2.png) [@littleskunk](https://forum.storj.io/u/littleskunk)\ **Post date:** [June 6, 2024, 3:03pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/828 "2024-06-06T15:03:08Z")
I forgot to give an update on the test results from yesterday. It looks like we are already running the RS numbers with the lowest storage expansion factor and the lowest long tail. There isn’t much I can do to make it more efficient without reducing the throughput below our target. We found out that the more we fill the network with data the lower the throughput will get. It will fall below our target over time. We have some variables that allow us to get the performance above the target again by increasing the long tail or the choiceof factor. Now our hope is also that by keeping up the load we can motivate more nodes to join the network. At the current rate we would overshoot the required capacity at some point so it is time to change the load pattern to a more dynamic one that hits the target throughput for a few hours per day and reduces it a bit for the rest of the day to match the expected usecases as good as possible. That will be the moment you can start planning to add more nodes 🙂 ---
**Author:** ![littleskunk](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/littleskunk/32/63_2.png) [@littleskunk](https://forum.storj.io/u/littleskunk)\ **Post date:** [June 6, 2024, 3:09pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/829 "2024-06-06T15:09:51Z")
> [@BrightSilence](#): > > I thought bloom filters were always based on several days old snapshots. How could it even delete data within that 24 hour period? Check your trash folder. For some satellites I had 3 bloom filters in the last 7 days. So they must have changed it. ---
**Author:** ![nerdatwork](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/nerdatwork/32/1135_2.png) [@nerdatwork](https://forum.storj.io/u/nerdatwork)\ **Post date:** [June 6, 2024, 3:20pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/830 "2024-06-06T15:20:46Z")
> [@littleskunk](#): > > For some satellites I had 3 bloom filters in the last 7 days Is it normal to have 2 bloom filters for a single satellite that are 30 mins apart as per their timestamp ? ---
**Author:** ![pangolin](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/pangolin/32/15685_2.png) [@pangolin](https://forum.storj.io/u/pangolin)\ **Post date:** [June 6, 2024, 3:23pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/831 "2024-06-06T15:23:27Z")
> [@littleskunk](#): > > Now our hope is also that by keeping up the load we can motivate more nodes to join the network. My nodes have lost almost half of data from the peak. Your 30 days TTL test data makes it not more shrinking at best. I guess it needs some real growth to motivate me. Or at least a signed contract from one of those big customers you talking about. ---
**Author:** ![agente](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/agente/32/1137_2.png) [@agente](https://forum.storj.io/u/agente)\ **Post date:** [June 6, 2024, 3:39pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/832 "2024-06-06T15:39:22Z")
> [@littleskunk](#): > > Now our hope is also that by keeping up the load we can motivate more nodes to join the network. If you keep up load that disappear in 30 days you’ll demotivate SNOs for the extra effort (networking and caching, especially if you have multi nodes) for the same earnings. You need to fill that nodes with data without TTL or with a growing path including TTL to motivate SNOs. Are you going to grow data uploaded in this way? ---
**Author:** ![littleskunk](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/littleskunk/32/63_2.png) [@littleskunk](https://forum.storj.io/u/littleskunk)\ **Post date:** [June 6, 2024, 3:51pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/833 "2024-06-06T15:51:46Z")
> [@agente](#): > > You need to fill that nodes with data without TTL or with a growing path including TTL to motivate SNOs. That would be the wrong set of SNOs. We need SNOs that join the network accepting the TTL data because that will be uploaded later on. ---
**Author:** ![flwstern](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/flwstern/32/7821_2.png) [@flwstern](https://forum.storj.io/u/flwstern)\ **Post date:** [June 6, 2024, 4:15pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/834 "2024-06-06T16:15:50Z")
But if our disks is not getting filled, and our disks is just getting hammered and we dont get payed for this why would we expand? Can you eleborate on this? ---
**Author:** ![littleskunk](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/littleskunk/32/63_2.png) [@littleskunk](https://forum.storj.io/u/littleskunk)\ **Post date:** [June 6, 2024, 4:24pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/835 "2024-06-06T16:24:19Z")
I can’t speak for everyone in the room. I can only speak for myself. For my own nodes I did the math. I don’t know why your math ends up with 0 payout but for my node the outcome is a decent payout that I am getting from this usecase. Luckily my setup is already perfect. I have way too much hard drive capacity and now I can make use of that. I have enough memory to not worry about garbage collection. It takes just minutes. The only variable that limits my payout is my bandwidth. I ordered a faster internet connection and soon my ISP will just flip the switch on his side. I am fine with the new situation and I am happy to take the money that you don’t want. Or maybe you haven’t done the math yet. ---
**Author:** ![Roxor](https://storj.bcdn.literatehosting.com/letter_avatar/roxor/32/5_5575768a8748004e209b776fc1b2916d.png) [@Roxor](https://forum.storj.io/u/Roxor)\ **Post date:** [June 6, 2024, 4:29pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/836 "2024-06-06T16:29:28Z")
I thought Storj was going to try to maintain a certain amount of reserved-capacity (like 5PB or something, just to guess a number) and then any other growth would be natural/customers? So essentially Storj is pre-paying SNOs for some space now… to make sure they have time to add disks before natural demand catches up? So yes that would mean SNOs grow faster for awhile… but will level-off later… so every day fresh reserved-capacity ingress only covers reserved-capacity TTL deletes. If that’s the plan, or close to it, I’m fine with it. ---
**Author:** ![Andrew](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/andrew/32/1139_2.png) [@Andrew](https://forum.storj.io/u/Andrew)\ **Post date:** [June 6, 2024, 4:39pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/837 "2024-06-06T16:39:56Z")
> [@littleskunk](#): > > That would be the wrong set of SNOs. This forum really needs a dislike button. ---
**Author:** ![littleskunk](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/littleskunk/32/63_2.png) [@littleskunk](https://forum.storj.io/u/littleskunk)\ **Post date:** [June 6, 2024, 4:43pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/838 "2024-06-06T16:43:18Z")
> [@Andrew](#): > > This forum really needs a dislike button. Sure you can dislike my messages but that isn’t going to change reality. You have still time to adopt. I have given plenty of warnings regarding the new upload pattern. [Previous page](https://forum.storj.io/t/updates-on-test-data/26034.md?page=36) [Next page](https://forum.storj.io/t/updates-on-test-data/26034.md?page=38)