Low Download Rate

Dear Community,

We have setup a node with 1.5 PiB of storage. It has been running for 1 week, but the downloaded data is only 50 GB. Our bandwidth is 250 Mbit/s.

How can we improve the download and disk usage rate?

Best regards

Bjorn

Here’s what to expect:

2 Likes

Thank you, but how do we improve the download rate. 50 GB after one week of operation seems a bit low to us.

Have you setup 1.5 PB for one Node? My last knowledge is that there is a maximum of 24 TB per Node.

You can check this link as well:

Actually you can’t improve or increase the disk usage. STORJ is meant for low bandwith usage, CPU usage to run also on like Raspberry Pi’s.

But you can get other opinions as well.

You need more internet connections

There are OS’s that allow you to create large pools

to fill this space you need something lika 50-100 external ips from ditterent \24 space other you wont get lot of data, and then 250 mbit is too small.

Would it be Ubuntu or Windows?

Thanks! Is there a provider with this kind of service?

Just one example

Hello BHK,

quick rundown of a few points going only very surface level:

  1. You have a vetting status at the beginning for each satellite. During that time you only get 5% of the traffic. Once you reach 100 “Checks” with a satellite you are vetted and get the 95%
  2. Traffic is split over all nodes equally based on /24 public subnets. So even if you have a 1.5Petabyte Storage you get the same input as a different node with 5 TB Storage. As long as some space is free each node is treated the same (factors like how close to the upload source you are, etc. do also play a role)
  3. This is not a crypto like with Chia where you just generate data for ever. So you only get data if customers are actually uploading data. So if there are 14.000 nodes and in 1 month only 1TB is uploaded by customers that is split between those 14.000 nodes.
  4. https://storjstats.info shows a few statistics and you can see the whole network “only” has 31.2 Pb of storage in total across all nodes. You can check the Ingress /egress for each satellite in the last 30 days and also check the total number of nodes there to get a idea of how much you might be getting.

TLDR: Till you are vetted 50GB in a week sounds about right. Once I got vetted and all problems solved I am at about 50-55 Ingress per day.

1.5 PiB? IMO you have to wait about 300 years to fill that storage :smiley:
5TB/y is optimistic, 1500/5 = 300.