Bandwidth utilization comparison thread

Fully vetted 7.5 month old node (1.57TB stored)

fully vetted 16 month node (15TB stored)
have had a bit of uptime issues and a couple of reboots, so lagging behind a bit.
my problems should be solved now, so now i have a reference for the rest of the month…

1 Like

There are a lot of deletes going on. I saw 60GB in trash and its slowly coming down as items are being expired (trash retained for 7 days after deletion). I saw someone else’s full older node getting 180GB deleted, so they are now taking new ingress as they fill back up. It looks like another 10 days till they are full again, so we should see more Ingress from 16th July.

I am currently averaging 12GB Ingress and 9GB egress per day, on 1.57TB at 7.5 months old. Going by these stats, I should get to monthly 1TB egress in another 11.5 months!!

yeah … i was hoping to break 16TB this month on my oldest node…
alas now i’ll be happy not to go below 15 lol
that being said i did have 10% downtime last month or so… which hasn’t exactly helped i’m sure…

Your deletes must have been unwanted on 15TB!! From what you said and scaling up from my figures, I would guess your deletes were 600GB? Ha… I am aiming for 1.9TB this month, unless we get a bunch more deletes.

i think this might be what we should expect from here on out…
generally the avg ingress pr month has been about a minimum of 500GB for a fully vetted node with full uptime.

egress is a bit random… yesterday i saw 80GB on my 15TB node.
i forget the exact number… but all in all usually the earned for a node is 3.3$ pr TB stored at present.
so 10 months would give 5TB stored which would earn 33$ pr month on an avg node working in near optimal conditions.

won’t make one rich, but should offset the costs involved for most node operators if one keeps the overhead cost down.

1 Like

I wonder why I only have 520GB stored. Does it matter how many TB (got 3TB dedicated now) I have allocated to storj? I began in the end of February. Just curious how you guys already have 1,5TB stored after 7 months?

I assume, customer deletes data, satellite is updated, then nodes are instructed to trash the deleted data. I would expect it to be more fluid than the quarterly mass delete we are seeing…

I also read $3.3 per TB/m somewhere, but for last 2 months, I am seeing average of $5.1 TB/m (on gross value)

I am running STORJ on a Windows 2019 server that is always on, with a 14TB WD Gold drive (12.5TB after formatting), so no real additional cost.

1 Like

As you become vetted (per satellite) you see 20x more traffic. Unvetted node gets 5%, vetted node gets 100%. You just have to sit and wait :slight_smile:

My dates were

24th Dec 2020 started
14th Jan 2020 US2 Vetted
20th Jan 2021 Saltlake Vetted
24th Jan 2021 Europe West 1 Vetted
27th Jan 2021 US Central 1 Vetted
26th Jun 2021 EU North Vetted (Yes 7 months!!)

My values are

TB (avg) $ (gross) $ per TB
june 1.34 7.6 5.7
may 1.08 4.78 4.4
apr 0.79 2.22 2.8
mar 0.6 1.49 2.5
feb 0.19 0.76 4.0
jan 0.05 0.26 5.2

image

can be really slow going.

this one is from the 8th of april
tho the payout thing claims its on it’s 4th month… 4th payout maybe…
also pretty sure it has had a month where it shared an ip’s with another node.
has been seeing good ingress on it since we got the high ingress the previous month.

ofc i guess high ingress sort of kills itself… even if sustained… nodes get vetted faster and thus the network grows faster…

maybe the vetting process needs to be different, ofc this way everyone is evenly matched…
but might be nice if existing nodes would benefit more from uplifts…

as it is i suppose (just thinking out loud here…) if we imagine an unlimited number of incoming nodes, more ingress equals more vetted nodes which get full shares of the ingress…

might be a better way… both for the network and node ops :smiley:

Thanks for answering and explaining it to me. I allocated 10TB to the node. I’m running SHR1 on my node which means data got spread across 4 drives. Guess it will be more load on the drives. How do you check when you get vetted on each satellite? Mine shows like this:

I don’t know of an easy way, so just filtered the log for audit and counted per satellite ID

There is a way by using API language or by using earnings calculator that is available here in forum just search for it. (easier to execute but it requires python installed i think)
With API - it is a little tricky (quite manual):
evoke this command in your browser where you connect to your dashboard:
http://localhost:14001/api/sno/ (example for my dashboard - be mindful that my port might be different than yours - 14001 instead of 14003 i think)
You will get something looking like that:


Notice the id: strings
Now you can evoke those commands:
http://localhost:14001/api/sno/satellite/${id}
example : http://localhost:14001/api/sno/satellite/12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo/
It will return this kind of text to your browser

The totalCount is the amount of “checks” this sattelite issued each day. When they add up to 100 your node will be vetted on this particular sattelite.
The more data you have the more probability for a higher count each day.
This is pretty old node so counts are high.
Usually at the beginning there will be 0-1 count a day.

You have to check every satelliteID to see how much progress you have.
Here is a link to whole API

this one is pretty simple to use tho…
does require python tho

1 Like

I haven’t reached 100 on any satellite yet. Guess I need to wait a few more months for the node to be vetted. I still find the points going up and down is a bit strange.

Not that simple unfortunately ^^’
See:

So if vetted nodes usually get more ingress than unvetted ones, it’s usually less than 20x more in practice.

1 Like

shouldn’t go down… a successful audit should count and you need 100 of those…

but i have to admit it’s been software eons since i looked at my vetting nodes audits…
so reality might not conform to my belief, which might explain why it takes so long to vet these days…

but i will assume you are wrong, about the successful audits going down (vetting)

I post the values från us2.storj.io:7777

{“id”:“12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo”,“storageDaily”:[{“atRestTotal”:266071181307.74118,“intervalStart”:“2021-07-01T00:00:00Z”},{“atRestTotal”:266992652040.409,“intervalStart”:“2021-07-02T00:00:00Z”},{“atRestTotal”:266515498497.8899,“intervalStart”:“2021-07-03T00:00:00Z”},{“atRestTotal”:267810368708.58975,“intervalStart”:“2021-07-04T00:00:00Z”},{“atRestTotal”:268159011580.37674,“intervalStart”:“2021-07-05T00:00:00Z”},{“atRestTotal”:268291499795.94833,“intervalStart”:“2021-07-06T00:00:00Z”},{“atRestTotal”:123556267467.31026,“intervalStart”:“2021-07-07T00:00:00Z”}],“bandwidthDaily”:[{“egress”:{“repair”:46452992,“audit”:29440,“usage”:5153536},“ingress”:{“repair”:30956288,“usage”:109329152},“delete”:0,“intervalStart”:“2021-07-01T00:00:00Z”},{“egress”:{“repair”:20227328,“audit”:33536,“usage”:9529856},“ingress”:{“repair”:15766016,“usage”:13592064},“delete”:0,“intervalStart”:“2021-07-02T00:00:00Z”},{“egress”:{“repair”:44227072,“audit”:23552,“usage”:4605952},“ingress”:{“repair”:34915584,“usage”:16172288},“delete”:0,“intervalStart”:“2021-07-03T00:00:00Z”},{“egress”:{“repair”:44175360,“audit”:28928,“usage”:3188736},“ingress”:{“repair”:35051520,“usage”:14173696},“delete”:0,“intervalStart”:“2021-07-04T00:00:00Z”},{“egress”:{“repair”:38980608,“audit”:22272,“usage”:2638848},“ingress”:{“repair”:27600640,“usage”:17047040},“delete”:0,“intervalStart”:“2021-07-05T00:00:00Z”},{“egress”:{“repair”:12889600,“audit”:27904,“usage”:5672192},“ingress”:{“repair”:10119168,“usage”:13097472},“delete”:0,“intervalStart”:“2021-07-06T00:00:00Z”},{“egress”:{“repair”:10484224,“audit”:4608,“usage”:2673408},“ingress”:{“repair”:7695872,“usage”:149033728},“delete”:0,“intervalStart”:“2021-07-07T00:00:00Z”}],“storageSummary”:1727396479398.2651,“bandwidthSummary”:745620480,“egressSummary”:251069952,“ingressSummary”:494550528,“currentStorageUsed”:11250851072,“audits”:{“auditScore”:1,“suspensionScore”:1,“onlineScore”:0.985075,“satelliteName”:“us2.storj.io:7777”},“auditHistory”:{“score”:0.985075490602543,“windows”:[{“windowStart”:“2021-06-07T00:00:00Z”,“totalCount”:17,“onlineCount”:17},{“windowStart”:“2021-06-07T12:00:00Z”,“totalCount”:24,“onlineCount”:24},{“windowStart”:“2021-06-08T00:00:00Z”,“totalCount”:27,“onlineCount”:27},{“windowStart”:“2021-06-08T12:00:00Z”,“totalCount”:20,“onlineCount”:20},{“windowStart”:“2021-06-09T00:00:00Z”,“totalCount”:25,“onlineCount”:25},{“windowStart”:“2021-06-09T12:00:00Z”,“totalCount”:22,“onlineCount”:22},{“windowStart”:“2021-06-10T00:00:00Z”,“totalCount”:27,“onlineCount”:27},{“windowStart”:“2021-06-10T12:00:00Z”,“totalCount”:20,“onlineCount”:20},{“windowStart”:“2021-06-11T00:00:00Z”,“totalCount”:17,“onlineCount”:17},{“windowStart”:“2021-06-11T12:00:00Z”,“totalCount”:17,“onlineCount”:17},{“windowStart”:“2021-06-12T00:00:00Z”,“totalCount”:22,“onlineCount”:22},{“windowStart”:“2021-06-12T12:00:00Z”,“totalCount”:49,“onlineCount”:49},{“windowStart”:“2021-06-13T00:00:00Z”,“totalCount”:52,“onlineCount”:52},{“windowStart”:“2021-06-13T12:00:00Z”,“totalCount”:55,“onlineCount”:55},{“windowStart”:“2021-06-14T00:00:00Z”,“totalCount”:57,“onlineCount”:57},{“windowStart”:“2021-06-14T12:00:00Z”,“totalCount”:52,“onlineCount”:52},{“windowStart”:“2021-06-15T00:00:00Z”,“totalCount”:50,“onlineCount”:50},{“windowStart”:“2021-06-15T12:00:00Z”,“totalCount”:44,“onlineCount”:44},{“windowStart”:“2021-06-16T00:00:00Z”,“totalCount”:36,“onlineCount”:36},{“windowStart”:“2021-06-16T12:00:00Z”,“totalCount”:45,“onlineCount”:45},{“windowStart”:“2021-06-17T00:00:00Z”,“totalCount”:60,“onlineCount”:60},{“windowStart”:“2021-06-17T12:00:00Z”,“totalCount”:39,“onlineCount”:39},{“windowStart”:“2021-06-18T00:00:00Z”,“totalCount”:45,“onlineCount”:45},{“windowStart”:“2021-06-18T12:00:00Z”,“totalCount”:62,“onlineCount”:62},{“windowStart”:“2021-06-19T00:00:00Z”,“totalCount”:54,“onlineCount”:54},{“windowStart”:“2021-06-19T12:00:00Z”,“totalCount”:77,“onlineCount”:77},{“windowStart”:“2021-06-20T00:00:00Z”,“totalCount”:76,“onlineCount”:76},{“windowStart”:“2021-06-20T12:00:00Z”,“totalCount”:69,“onlineCount”:69},{“windowStart”:“2021-06-21T00:00:00Z”,“totalCount”:72,“onlineCount”:40},{“windowStart”:“2021-06-21T12:00:00Z”,“totalCount”:64,“onlineCount”:38},{“windowStart”:“2021-06-22T00:00:00Z”,“totalCount”:67,“onlineCount”:67},{“windowStart”:“2021-06-22T12:00:00Z”,“totalCount”:67,“onlineCount”:64},{“windowStart”:“2021-06-23T00:00:00Z”,“totalCount”:55,“onlineCount”:55},{“windowStart”:“2021-06-23T12:00:00Z”,“totalCount”:49,“onlineCount”:49},{“windowStart”:“2021-06-24T00:00:00Z”,“totalCount”:45,“onlineCount”:45},{“windowStart”:“2021-06-24T12:00:00Z”,“totalCount”:81,“onlineCount”:81},{“windowStart”:“2021-06-25T00:00:00Z”,“totalCount”:73,“onlineCount”:73},{“windowStart”:“2021-06-25T12:00:00Z”,“totalCount”:67,“onlineCount”:67},{“windowStart”:“2021-06-26T00:00:00Z”,“totalCount”:56,“onlineCount”:56},{“windowStart”:“2021-06-26T12:00:00Z”,“totalCount”:79,“onlineCount”:79},{“windowStart”:“2021-06-27T00:00:00Z”,“totalCount”:65,“onlineCount”:65},{“windowStart”:“2021-06-27T12:00:00Z”,“totalCount”:79,“onlineCount”:79},{“windowStart”:“2021-06-28T00:00:00Z”,“totalCount”:67,“onlineCount”:67},{“windowStart”:“2021-06-28T12:00:00Z”,“totalCount”:53,“onlineCount”:53},{“windowStart”:“2021-06-29T00:00:00Z”,“totalCount”:61,“onlineCount”:61},{“windowStart”:“2021-06-29T12:00:00Z”,“totalCount”:49,“onlineCount”:49},{“windowStart”:“2021-06-30T00:00:00Z”,“totalCount”:47,“onlineCount”:47},{“windowStart”:“2021-06-30T12:00:00Z”,“totalCount”:69,“onlineCount”:69},{“windowStart”:“2021-07-01T00:00:00Z”,“totalCount”:56,“onlineCount”:56},{“windowStart”:“2021-07-01T12:00:00Z”,“totalCount”:59,“onlineCount”:59},{“windowStart”:“2021-07-02T00:00:00Z”,“totalCount”:59,“onlineCount”:59},{“windowStart”:“2021-07-02T12:00:00Z”,“totalCount”:72,“onlineCount”:72},{“windowStart”:“2021-07-03T00:00:00Z”,“totalCount”:58,“onlineCount”:58},{“windowStart”:“2021-07-03T12:00:00Z”,“totalCount”:34,“onlineCount”:34},{“windowStart”:“2021-07-04T00:00:00Z”,“totalCount”:60,“onlineCount”:60},{“windowStart”:“2021-07-04T12:00:00Z”,“totalCount”:53,“onlineCount”:53},{“windowStart”:“2021-07-05T00:00:00Z”,“totalCount”:35,“onlineCount”:35},{“windowStart”:“2021-07-05T12:00:00Z”,“totalCount”:52,“onlineCount”:52},{“windowStart”:“2021-07-06T00:00:00Z”,“totalCount”:48,“onlineCount”:48},{“windowStart”:“2021-07-06T12:00:00Z”,“totalCount”:61,“onlineCount”:61},{“windowStart”:“2021-07-07T00:00:00Z”,“totalCount”:17,“onlineCount”:17}]},“priceModel”:{“EgressBandwidth”:2000,“RepairBandwidth”:1000,“AuditBandwidth”:1000,“DiskSpace”:150},“nodeJoinedAt”:“2021-02-26T19:17:29.284129Z”}

I see that my onlinescore is : 0.985075

I think they are reported as checks/per day. So one day you might get more checks, next they less. When you add each day - that will be the cumulative score your node gathered.

And maybe they changed something in last few months… my nodes got vetted few months ago, so I stopped tracking the numbers…

1 Like

the count is for each satellite… i just use earnings calculator / earnings.py
it does write it in % but afaik the % would then be a successful audit. for that particular satellite


so much easier… you can just

basically you can from your storagenode terminal do, in the storj folder for the storagenode
#wget https://raw.githubusercontent.com/ReneSmeekes/storj_earnings/master/earnings.py

and then you do
python earnings.py

oh and you need to install python, but thats like sudo apt install python
or something…