# Updates on Test Data **URL:** \ **Category:** Announcements\ **Created:** [April 30, 2024, 3:36pm UTC](https://forum.storj.io/t/updates-on-test-data/26034 "2024-04-30T15:36:45Z")\ **Posts on this page:** 20\ **Page:** 55
**Author:** ![littleskunk](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/littleskunk/32/63_2.png) [@littleskunk](https://forum.storj.io/u/littleskunk)\ **Post date:** [June 13, 2024, 7:34pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/1210 "2024-06-13T19:34:23Z")
> [@Mitsos](#): > > I know the costs, I wasn’t suggesting you keep running it forever. I was suggesting that if one of the “big clients” has already signed up and “_will be_” is coming into effect, it’s better if the SNOs hear about it. If the client hasn’t signed up yet, that’s where “_may be_” is coming into effect. Ok got it. It will be a bit short notice. I expect just a few days between signing the contracts and the uploads hitting our nodes. So with the surge nodes we can buy time for the network to adopt to the new situation. > [@Mitsos](#): > > I think we have a right to be a bit more skeptical about any "will be"s. Yes. I am a node operator myself and fully agree on that. I have communicated that point to the stakeholders already. If we are lucky they might make a commitment to take the risk of no deal signed from the table. If the deals are getting signed we get a higher payout and if the deals are not getting signed we also get a higher payout. That would also allow us to start growing in advance. That commitment isn’t on me so lets wait and see how it will look like. > [@JWvdV](#): > > Can you elaborate on this? Could you please open a new thread for that and ask [@] elek how he did it? To my knowledge he managed to get a storage node down to a few minutes file walker with an inode cache. I don’t know the details but he can share his knowledge. ---
**Author:** ![flwstern](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/flwstern/32/7821_2.png) [@flwstern](https://forum.storj.io/u/flwstern)\ **Post date:** [June 13, 2024, 7:36pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/1211 "2024-06-13T19:36:22Z")
I have this exact same problem on some nodes only: ![image](https://storj-s3.bcdn.literatehosting.net/original/3X/f/4/f40aa324d40dda3874fa14808eee099b1454a543.png) My trash is empty but its not updating the trash to the node, so at the moment is thinking i have 6.5 TB in trash. Im monitoring the logs now and lets see what it says. But nodes on the same storage does not have this issue. And filewalkers are finished successfully. ---
**Author:** ![ACarneiro](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/acarneiro/32/1129_2.png) [@ACarneiro](https://forum.storj.io/u/ACarneiro)\ **Post date:** [June 13, 2024, 8:54pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/1212 "2024-06-13T20:54:04Z")
> [@littleskunk](#): > > Ok got it. It will be a bit short notice. I expect just a few days between signing the contracts and the uploads hitting our nodes. Thank you. I have a few old 6TB drives that I’ve spun up and got ready to start new nodes when you pull the trigger. If they fill up I’ll buy some decent SAS ones for more permanent use. Will there be any changes to vetting in order to speed up the process of bringing new nodes online? I think you alluded to that earlier on but not sure if that is actually “a thing”. ---
**Author:** ![agente](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/agente/32/1137_2.png) [@agente](https://forum.storj.io/u/agente)\ **Post date:** [June 13, 2024, 8:59pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/1213 "2024-06-13T20:59:27Z")
> [@flwstern](#): > > And filewalkers are finished successfully. used filewalker? Sure? ---
**Author:** ![BrightSilence](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/brightsilence/32/6048_2.png) [@BrightSilence](https://forum.storj.io/u/BrightSilence)\ **Post date:** [June 13, 2024, 9:21pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/1214 "2024-06-13T21:21:09Z")
> [@flwstern](#): > > I have this exact same problem on some nodes only: No you don’t, that’s a different problem. I mean you might have the same problem as well in addition to that, but the dashboard won’t show you if you do. ---
**Author:** ![flwstern](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/flwstern/32/7821_2.png) [@flwstern](https://forum.storj.io/u/flwstern)\ **Post date:** [June 13, 2024, 9:41pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/1215 "2024-06-13T21:41:28Z")
Yeah i deleted all the databases now and let it run thru from scratch and it should show the correct info in the dashboard. ---
**Author:** ![Toyoo](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/toyoo/32/1126_2.png) [@Toyoo](https://forum.storj.io/u/Toyoo)\ **Post date:** [June 13, 2024, 10:16pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/1216 "2024-06-13T22:16:23Z")
> [@littleskunk](#): > > The costs are low enough for that. I assume you have considered the surge nodes to also only be chosen for downloads if there’s not enough regular nodes? Whatever the place you will pick to host the surge nodes, this would reduce your egrees while maybe making SNOs a little bit happier (at least those who would not complain about their egrees). > [@littleskunk](#): > > All the nodes are happy and the moment the peak load is over they start a new thread complaining about the reduced traffic. That’s just life… ---
**Author:** ![Roxor](https://storj.bcdn.literatehosting.com/letter_avatar/roxor/32/5_5575768a8748004e209b776fc1b2916d.png) [@Roxor](https://forum.storj.io/u/Roxor)\ **Post date:** [June 13, 2024, 10:37pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/1217 "2024-06-13T22:37:54Z")
> [@littleskunk](#): > > I think we filled like 3000 nodes in the past week. So if these nodes would add some extra hardware drives (if possible with their setup) that would get us back to the throughput we had a week ago. It sounds like a lot of SNOs need to put their money where there mouth is. Lots of talk of “when I fill… I’ll expand”, so we’ll see if that’s true. Because that’s over 10% of online nodes: if they stop accepting ingress it’s definately significant. ---
**Author:** ![ACarneiro](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/acarneiro/32/1129_2.png) [@ACarneiro](https://forum.storj.io/u/ACarneiro)\ **Post date:** [June 13, 2024, 10:51pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/1218 "2024-06-13T22:51:34Z")
Many of us are weary of investing in resources for test data… ---
**Author:** ![Toyoo](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/toyoo/32/1126_2.png) [@Toyoo](https://forum.storj.io/u/Toyoo)\ **Post date:** [June 14, 2024, 1:06am UTC](https://forum.storj.io/t/updates-on-test-data/26034/1219 "2024-06-14T01:06:25Z")
> [@Roxor](#): > > Lots of talk of “when I fill… I’ll expand”, so we’ll see if that’s true. So far my nodes didn’t even get back to the pre-deletions level. Storj doesn’t want my nodes now 🤷 ---
**Author:** ![Mitsos](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/mitsos/32/1125_2.png) [@Mitsos](https://forum.storj.io/u/Mitsos)\ **Post date:** [June 14, 2024, 3:49am UTC](https://forum.storj.io/t/updates-on-test-data/26034/1220 "2024-06-14T03:49:36Z")
> [@Roxor](#): > > It sounds like a lot of SNOs need to put their money where there mouth is. Lots of talk of “when I fill… I’ll expand”, so we’ll see if that’s true. Because that’s over 10% of online nodes: if they stop accepting ingress it’s definately significant. Not yet full, so not yet expand 😄 As a reminder, if the uploaded test data is 30day TTL, it’s almost time to be deleted. We’ll see how that works out as well, and go from there. We can also see it on the flip side as well: After a month of pushing everything to the limits (and sometimes beyond), 10% of the nodes became full. ---
**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\ **Post date:** [June 14, 2024, 7:40am UTC](https://forum.storj.io/t/updates-on-test-data/26034/1221 "2024-06-14T07:40:18Z")
> [@JWvdV](#): > > and the uptime is being reset Do you mean the Uptime on the dashboard? If it’s reset, then probably the node is restarted. Please check your logs (both - for storagenode and storagenode-updater), why is it restarted? The last message before a restart should have some explanation (unless you have had a power cut for a moment… but in this case `dmesg` or `journalctl` should show something). ---
**Author:** ![pasatmalo](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/pasatmalo/32/1127_2.png) [@pasatmalo](https://forum.storj.io/u/pasatmalo)\ **Post date:** [June 14, 2024, 8:32am UTC](https://forum.storj.io/t/updates-on-test-data/26034/1222 "2024-06-14T08:32:13Z")
> [@littleskunk](#): > > Worst case the dashboard is correct and we might see some extensive garbage collection. Referring back to this, currently I have started seeing a large amount of the test data get garbage collected: [![](https://i.imgur.com/NpJO60L.png) ](https://i.imgur.com/NpJO60L.png) This might give insights to the issue you were diagnosing with the dashboard. To my untrained eye, it looks like the TTL data uploaded is not being correctly registered as “active” data, and therefore is being removed by GC before TTL kicks in. ---
**Author:** ![pangolin](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/pangolin/32/15685_2.png) [@pangolin](https://forum.storj.io/u/pangolin)\ **Post date:** [June 14, 2024, 9:51am UTC](https://forum.storj.io/t/updates-on-test-data/26034/1223 "2024-06-14T09:51:24Z")
One of my nodes just moved like half of its data to trash. Seems to be data from slc sat. 🤔 Dashboard makes me thinking this data was never correct registered by satellite and will not be paid. 🙄 ---
**Author:** ![peter\_linder](https://storj.bcdn.literatehosting.com/letter_avatar/peter_linder/32/5_5575768a8748004e209b776fc1b2916d.png) [@peter\_linder](https://forum.storj.io/u/peter_linder)\ **Post date:** [June 14, 2024, 10:06am UTC](https://forum.storj.io/t/updates-on-test-data/26034/1224 "2024-06-14T10:06:41Z")
I will probably expand by adding 20-30 nodes in the near future. Nothing close to 1000 of course but I think other people will add capacity as well. It takes a little bit of time though. Right now I’m just trimming away some free space on existing nodes. ---
**Author:** ![Frieseba](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/frieseba/32/6488_2.png) [@Frieseba](https://forum.storj.io/u/Frieseba)\ **Post date:** [June 14, 2024, 11:10am UTC](https://forum.storj.io/t/updates-on-test-data/26034/1225 "2024-06-14T11:10:18Z")
Since a lot of data on my node has been deleted again, I don’t need to create a new node for now. I have plenty of space again. ---
**Author:** ![flo82](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/flo82/32/10747_2.png) [@flo82](https://forum.storj.io/u/flo82)\ **Post date:** [June 14, 2024, 12:29pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/1226 "2024-06-14T12:29:54Z")
Data deletion will start on sunday ---
**Author:** ![MarviBiene](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/marvibiene/32/1124_2.png) [@MarviBiene](https://forum.storj.io/u/MarviBiene)\ **Post date:** [June 14, 2024, 12:50pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/1227 "2024-06-14T12:50:01Z")
I still don’t understand why the dashboard can not provide reliable data. As a customer it is good to have good and right data. And we as node operator are in my opinion the same as paying customers. I really don’t want to complain but the stats are almost every month wrong from the satellite. The public status page is inconsistent and so on. Why is that so? And how do we know if the satellite knows the right data? And why is it sending wrong/no data to the storage nodes if it knows the real value? I really like the project and will continue to support it, but i wasn’t able to find clarification for that. All that I was finding is “The satellite knows the right data and you will get paid the right amount”. ---
**Author:** ![Roxor](https://storj.bcdn.literatehosting.com/letter_avatar/roxor/32/5_5575768a8748004e209b776fc1b2916d.png) [@Roxor](https://forum.storj.io/u/Roxor)\ **Post date:** [June 14, 2024, 12:52pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/1228 "2024-06-14T12:52:56Z")
> [@MarviBiene](#): > > And we as node operator are in my opinion the same as paying customers. SNOs are service providers: we don’t pay Storj like customers: we _get_ paid. And payouts have been correct month-after-month. If we don’t feel we’re getting paid adequately: we stop providing our service (and find another project) ---
**Author:** ![Andrew](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/andrew/32/1139_2.png) [@Andrew](https://forum.storj.io/u/Andrew)\ **Post date:** [June 14, 2024, 1:01pm UTC](https://forum.storj.io/t/updates-on-test-data/26034/1229 "2024-06-14T13:01:50Z")
> [@BrightSilence](#): > > at the moment uncollected garbage and trash account for almost a third of my used capacity I have the same problem: 71 TB in trash and 166 TB used. Ext4, 2 nodes on a single HDD (I know that in the “new Storj reality” we shouldn’t use more than 1 node per HDD, but we’ve been here for years and we have what we have). It’s been a while since the last time my nodes completed GC on the US satellite, which is why I have had so much data that should be removed. What I really don’t understand is why the devs took so long to roll out version 1.105.4 to Docker until yesterday (this version fixes a critical bug with removing retain files when the node is restarted). It is obvious that many SNOs restarted their nodes while tests are running to adapt to increased data flow and lost retain files because of the bug. If there is someone like me with a lot of unremoved trash (I mean in used, not in the trash directory) and still not updated manually to 1.105.4 (I did it a couple of weeks ago), then it will be another month before their nodes clean themselves up. If I understood @littleskunk correctly, this may decrease network throughput. [Previous page](https://forum.storj.io/t/updates-on-test-data/26034.md?page=54) [Next page](https://forum.storj.io/t/updates-on-test-data/26034.md?page=56)