Updates on Test Data

So best correct answer is Everyone should calculate it by themselves.
take 5or 10 day average added space(not ingress) then you can estimate how much you will get a day and then x30 thats all.

3 Likes

You sound skeptical, but this is actually useful information for me. I think my nodes are tending towards the upper range of performance and now I can decide a little bit what I should do. Probably wouldn’t be worth it to buy more than 2x20TB per IP and I might get rid of half of my IP’s as the test has shown there are diminishing returns with the new node selection. So maybe I’ll hold on to 3 of them and buy 6 20TB HDD’s. Or start with 3 and see how fast they fill. I know buying more is not going to be worth it now.

Also, I think the lower range is technically 0TB as it is theoretically possible that you are almost never selected.

That said, I wasn’t aware the n number would be this high, so I was indeed expecting smaller ranges. Still, this information is still more valuable than ā€œbig deal signedā€.

4 Likes

Bryanm, why don’t You guys just include in the contract a time for safe kick off.
some start-up clause, like ā€œat the first 90 days of a cooperation, if the offered space turns out to be not enough at some point, we are obligated to provide needed storage in not longer than 3 monthsā€ or something. Take stress out of Your selfs.

This is a tank with hungry fishes. Seems we can hoover everything thrown at us. But the meat have to be in the tank first!

Or, if the meat is x2, x3 like good ol’ surge times? man that will be gone in no time!

1 Like

If we have over 22000 nodes, but only 6000 with free-space… then we’re not that hungry. It means most SNOs that filled a node… didn’t bring any new space online. And now we’re being paid for an additional 20PB of reserved-capacity and still waffling on expansion?

Storj needs those burst nodes, yesterday.

2 Likes

It took me a while to find this answer. I also tested several IP addresses and there latency, and the latency is pretty high at my location (Netherlands).

I tested 2 completely different type of internet connections/providers and just for fun, on my mobile phone. This probably explains why I don’t get more throughput even after I created more nodes and assigned more resources to the older nodes. The last few days it was almost stable at the 100mbit. The days before I had traffic for several hours per day that went up to 160mbit.

For all I know, everything runs fine on my side. No crashing/rebooting docker containers, no hiccups in internet connectivity (I work from home with VPN and remote sessions and had several MSTeams meetings without any problems). Even with running filewalker or GC, other nodes picked up the slack. So I’m quiet happy how stable everything is. I also expanded my old nodes to be ready for new customers, and created new one for when I need them (also handy for testing).
The only ā€œissueā€ I see right now is the latency. So hopefully there are also some new big customers in the pipeline that are in Europe (even nicer, the Netherlands) that can bring my nodes on theire knees :slight_smile:

For reference, I had 4 nodes and created 8 extra in the last 2 weeks. Right now, 6 of the 12 nodes have available capacity. The others 6 are sized as small as possible and already filled up, but are ready to put into action after I expand those.

My ping results

image

3 Likes

I’m hungry, and I have the room for more capacity. Unfortunately, I don’t have fiber (hopefully later this year). But with the current latency, its probably not gone matter that much.

But I hope they reconsider the current held back amount. Maybe it doesn’t matter much in the end. But somehow it does not feel right when you spin up extra disks, make new nodes, etc while in the first year a large portion of the payout will be held back. Meanwhile my power bill needs to be paid each month. I know the logic behing the held back payouts, but someone can dream… :smiley:

I believe that a constant input of data for a long time will make SNOs improve their disks and network bandwidth faster and faster. A contract signed with Storj is not a contract signed with SNOs so we have no guarantee of return

This new volume of data is testing, and it is still for a short time. Many like me may have improved their network and disks now, but with little time in the ā€œnew normalā€, continuing to make improvements will be difficult because we don’t even have 30 days of input volume.

1 Like

This is interesting. Ingress fell to zero:

Node is still running, but the logs are only showing GET requests. Audit, suspension scores are 100%, online scores are over 99%. I can understand the tests being stopped, but no uploads at all? No customer is even trying to upload to my node?
Node version is 1.104.5, according to version.storj.io it is the minimum, so it should not be too old.

1 Like

Does your node think it’s full (so rejecting all ingress)?

1 Like

Yes, I’m an idiot. I knew that the node is soon going to run out of space, I expanded the virtual disk, but did not change the setting in node configuration. And then when traffic stopped I did not look at the dashboard.

1 Like

Ticket closed, resolution: PEBCAK :joy:

4 Likes

Hi all, only coming here from time to time. Around 15 days ago I spinned up a new node and am amazed by how quickly it is filling up:
image
Are we talking about test data only? Or customers data as well? If so do we have a rough idea of the proportions?

So, I’m confused, is this TTLed data you are currently uploading paid or not?

It’s paid.
There was a very small upload that was unpaid at the very start of the test run.

5 Likes

Hello @silaxe,
Welcome back!

There are both. And both are paid. So doesn’t matter for my opinion (I’m a SNO too).

I would like to start a new node, but vetting takes a very long time. I started a new node a week ago. It received a decent amount of data on the first day. Since then, only 40 B ingress per day. The log shows no errors. Sometimes a ā€˜Download canceled’ appears. But okay.

Is your node full or outdated?

Version 1.104.5 and 178Gb free space

That’s not a lot of space. And how did you measure 40B ingress? That’s not even noise…
Are you sure your numbers are right?
Do you have any more space in your HDD that you could allocate?

In the ingress, I refer to the information provided by the graph. I used a small hard drive that I already had to start the vetting process and to monitor the further development of the traffic. If necessary and worthwhile, I plan to purchase a larger hard drive and transfer the existing data onto it.