# Publicly Exposed Network Data (official statistics from Storj DCS satellites) **URL:** \ **Category:** Product Discussions\ **Created:** [June 1, 2021, 7:10pm UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103 "2021-06-01T19:10:47Z")\ **Posts on this page:** 17\ **Page:** 2
**Author:** ![Stob](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/stob/32/1137_2.png) [@Stob](https://forum.storj.io/u/Stob)\ **Post date:** [June 4, 2021, 8:13am UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/22 "2021-06-04T08:13:43Z")
Strange. Even if I Ctrl+F5 I don’t see that. ![image](https://storj-s3.bcdn.literatehosting.net/original/2X/3/3fec1a48e5539fc11ce8244a2dc07788537650d2.png) ---
**Author:** ![rafael](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/rafael/32/1122_2.png) [@rafael](https://forum.storj.io/u/rafael)\ **Post date:** [June 4, 2021, 12:18pm UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/23 "2021-06-04T12:18:50Z")
@Stob Could you try an incognito tab or another browser? ---
**Author:** ![Stob](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/stob/32/1137_2.png) [@Stob](https://forum.storj.io/u/Stob)\ **Post date:** [June 4, 2021, 12:47pm UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/24 "2021-06-04T12:47:21Z")
Thanks. I’ve reset Chrome and the page now shows the full\_nodes description. ---
**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\ **Post date:** [June 4, 2021, 9:42pm UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/25 "2021-06-04T21:42:43Z")
A post was split to a new topic: [I would love a way to see when downtime events are recorded](https://forum.storj.io/t/i-would-love-a-way-to-see-when-downtime-events-are-recorded/14149) ---
**Author:** ![XenonOrion](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/xenonorion/32/69_2.png) [@XenonOrion](https://forum.storj.io/u/XenonOrion)\ **Post date:** [June 9, 2021, 6:27pm UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/26 "2021-06-09T18:27:35Z")
This is a great resource for SNOs, the transparency is highly appreciated! @brandon, could you elaborate a bit more on the meaning of **storage\_free\_capacity\_estimate\_bytes**? - Is this the total bytes available, or an estimate of how much data **customers** can store on the network (with or without erasure encoding expansion factor)? - Does each satellite make it’s own assessment on the total capacity of the network (which is the reason why this value is similar for each satellite)? - Or is this the capacity available to each satellite, meaning it need to be aggregated over the satellites to get the total available capacity? So if I got this right, the total capacity of the network would go as follows (numbers are from 9th of June 2021): 1. Calculate total stored capacity, by aggregating over the satellites: **storage\_total\_bytes** = 8822579609707109 =\> **~8PB** 2. Use one of the satellite’s estimates of the free storage space: **storage\_free\_capacity\_estimate\_bytes** = 7173629764009581 =\> **~6PB** 3. Add the two up, which totals to a Storj network size of approximately **14 PB** , of which **55%** is in use. Do these numbers make sense? I was under the understanding the size of the network was in the **40PB** range [[reddit](https://www.reddit.com/r/siacoin/comments/n5uakd/storage_capacity/)]? Another option is to aggregate the **storage\_free\_capacity\_estimate\_bytes** over the satellites as well, resulting in approximately **46PB** (with **~20%** in use). But this begs the question why each satellites is approximating only a part of the network, and is so equally distributed over the satellites? ---
**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\ **Post date:** [June 9, 2021, 7:13pm UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/27 "2021-06-09T19:13:01Z")
> [@XenonOrion](#): > > - Is this the total bytes available, or an estimate of how much data **customers** can store on the network (with or without erasure encoding expansion factor)? > - Does each satellite make it’s own assessment on the total capacity of the network (which is the reason why this value is similar for each satellite)? > - Or is this the capacity available to each satellite, meaning it need to be aggregated over the satellites to get the total available capacity? This is capacity advertised by nodes. Theoretical it can be used by customers, if nodes are not lie. ---
**Author:** ![rafael](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/rafael/32/1122_2.png) [@rafael](https://forum.storj.io/u/rafael)\ **Post date:** [June 9, 2021, 8:03pm UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/28 "2021-06-09T20:03:55Z")
Nodes are automatically added to all satellites, so when a satellite observes a reported `free_disk` value, others will see more or less the same value (subject to metainfo fluctuations which will update the `free_disk` value for other satellites also). Thus you don’t want to add the free capacity per satellite, as this is essentially counting the same reported space multiple times. The `free_disk` reported is showing bytes available on nodes. Thus this is post-expansion capacity available. Also, it’s worth mentioning that the amount we report is a conservative/pessimistic estimate. taking total reported free per node does indeed result in high values of `free_disk` available (probably in the **40pb** range seems right). But for a variety of reasons we want to be pessimistic about the amount we actually have free (to account for potential node pool fluctuations and accommodate growth planning more cautiously, to name two) ---
**Author:** ![Arkina](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/arkina/32/6137_2.png) [@Arkina](https://forum.storj.io/u/Arkina)\ **Post date:** [June 16, 2021, 12:11pm UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/29 "2021-06-16T12:11:13Z")
I working on a Prometheus/Grafana integration, which I (maybe) want to make publicly available. Now some Stuff which i think would be nice to have implemented: - Statistics Versioning incl. Changelog - Satelitenames as key/value pair, instead of having them as key ---
**Author:** ![Arkina](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/arkina/32/6137_2.png) [@Arkina](https://forum.storj.io/u/Arkina)\ **Post date:** [June 17, 2021, 9:50am UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/30 "2021-06-17T09:50:45Z")
So far so good, i now scrape all the Data via Exporter to Prometheus and can add Graphs to Grafana. i am not really a pro but i will create an initial Dashboard, actual State: ![dashboard_wip](https://storj-s3.bcdn.literatehosting.net/original/2X/0/03d5687fe5172eba8bc2ce1bf87ee561ed66088e.jpeg) if someone want to contribute, let me know, i think there are more talented guys out here 😉 Another short Question regarding the numbers. If i want to show capacity vs usage i think i need these values: - **storage\_remote\_bytes** - number of bytes stored on storage nodes (does not take into account the expansion factor of erasure encoding) - **storage\_free\_capacity\_estimate\_bytes** - statistical estimate of free storage node capacity, with suspicious values removed Regarding the Description of storage\_remote\_bytes i need to multiply it with the expansion factor (which is 2.7) to get the real amount of data stored across all nodes, right? ---
**Author:** ![kevink](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/kevink/32/6077_2.png) [@kevink](https://forum.storj.io/u/kevink)\ **Post date:** [June 17, 2021, 10:06am UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/31 "2021-06-17T10:06:55Z")
Looks good, mabe you can share your exporter already? Then others can create dashboards with it too. My preferred way of creating dashboard is something like this (similar to how the storagenode dashboards are organized): 1. Overview over the complete network (stats of all satellites combined) 2. Toggleable overview over all satellites (could be like the one you made or a boomtable) 3. Multiple rows with details per satellite (automatically generated for each satellite) One could also think about separating the combined stats of customer-facing satellites and test satellites as the stats between those 2 categories will be quite different. (i guess) > [@Arkina](#): > > Regarding the Description of storage\_remote\_bytes i need to multiply it with the expansion factor (which is 2.7) to get the real amount of data stored across all nodes, right? Well I guess that’s a bit more tricky because only newly uploaded pieces have all erasure pieces stored on the network. Older pieces will have lost some of those already. other pieces might have gotten repaired recently and have all erasure pieces again. So 2.7 might be the maximum but the real average will be lower (but haven’t looked at the exposed stats, maybe there’s some more useful information there because I remember some stats about repair pieces etc?) ---
**Author:** ![Arkina](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/arkina/32/6137_2.png) [@Arkina](https://forum.storj.io/u/Arkina)\ **Post date:** [June 17, 2021, 3:15pm UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/32 "2021-06-17T15:15:43Z")
> [@kevink](#): > > My preferred way of creating dashboard is something like this (similar to how the storagenode dashboards are organized): > > 1. Overview over the complete network (stats of all satellites combined) > 2. Toggleable overview over all satellites (could be like the one you made or a boomtable) > 3. Multiple rows with details per satellite (automatically generated for each satellite) > > One could also think about separating the combined stats of customer-facing satellites and test satellites as the stats between those 2 categories will be quite different. (i guess) > > Well I guess that’s a bit more tricky because only newly uploaded pieces have all erasure pieces stored on the network. Older pieces will have lost some of those already. other pieces might have gotten repaired recently and have all erasure pieces again. So 2.7 might be the maximum but the real average will be lower (but haven’t looked at the exposed stats, maybe there’s some more useful information there because I remember some stats about repair pieces etc?) Thx for the Feedback, for now i have worked on to get the site public available: [https://storjstats.info/](https://storjstats.info/) it only contains Data since yesterday evening, once i have a month of data i will adjust some settings otherwise ugly Stuff happens with the Graphs (depending on selected TimeRanges) I have enabled the Option to play around with the Stats/Graphs, but without the possibility to save Stuff. If someone has a better Dashboard, let me know, then i will be happy to add it 😉 > [@kevink](#): > > Looks good, mabe you can share your exporter already? Then others can create dashboards with it too. I am already working to finalize everything, then i will share it on Github, so Pullrequests for additional Dashboards can also be done there. EDIT: And here is the repo: [GitHub - toconspiracy/storj-stats: Grafanafrontend for Statistical Data from Storj](https://github.com/toconspiracy/storj-stats) ---
**Author:** ![kaloyan](https://storj.bcdn.literatehosting.com/letter_avatar/kaloyan/32/5_5575768a8748004e209b776fc1b2916d.png) [@kaloyan](https://forum.storj.io/u/kaloyan)\ **Post date:** [July 27, 2021, 10:48am UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/33 "2021-07-27T10:48:25Z")
We created a designated GitHub repo for proper project management around the public network stats: > **[GitHub - storj/stats: Storj DCS Public Network Statistics](https://github.com/storj/stats)** > > Storj DCS Public Network Statistics. Contribute to storj/stats development by creating an account on GitHub. For any bug reports or enhancement requests, please open an issue on this repo. ---
**Author:** ![brandon](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/brandon/32/1128_2.png) [@brandon](https://forum.storj.io/u/brandon)\ **Post date:** [September 9, 2021, 11:49am UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/34 "2021-09-09T11:49:53Z")
Hey Everyone, Incase you missed it we published a blog post about these metrics; check it out if you are interested. [Open Source and Open Data: Storj DCS Network Statistics](https://storj.io/blog/open-source-and-open-data-storj-dcs-network-statistics) ---
**Author:** ![prernaparashar](https://storj.bcdn.literatehosting.com/letter_avatar/prernaparashar/32/5_5575768a8748004e209b776fc1b2916d.png) [@prernaparashar](https://forum.storj.io/u/prernaparashar)\ **Post date:** [October 13, 2022, 4:58pm UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/35 "2022-10-13T16:58:45Z")
We are updating the way we calculate the values of **storage\_free\_capacity\_estimate\_bytes**. ---
**Author:** ![rafael](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/rafael/32/1122_2.png) [@rafael](https://forum.storj.io/u/rafael)\ **Post date:** [March 9, 2023, 1:23pm UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/36 "2023-03-09T13:23:54Z")
Hey everyone, I just wanted to let you all know about the latest updates to our public API. We have added two new metrics that will be useful for understanding the storage capacity of our network. The first new metric is **storage\_free\_capacity\_estimate\_vetted\_bytes**. This metric provides a statistical estimate of the free storage node capacity, but only considering vetted nodes. The second new metric is **storage\_total\_bytes\_after\_expansion** This metric gives the total number of bytes stored on the network after expansion by erasure coding. Erasure coding is a technique that expands data and distributes it across the network, making it more resilient to data loss. You can learn more about our durability and expansion factors here: [File Redundancy - Storj DCS Docs](https://docs.storj.io/dcs/concepts/file-redundancy/) Endpoint: [https://stats.storjshare.io/data.json](https://stats.storjshare.io/data.json) We believe that these new metrics will be a valuable addition to our public API. If you have any questions or feedback, please don’t hesitate to reach out. We would love to hear your thoughts. ---
**Author:** ![striker43](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/striker43/32/1135_2.png) [@striker43](https://forum.storj.io/u/striker43)\ **Post date:** [March 9, 2023, 1:37pm UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/37 "2023-03-09T13:37:32Z")
> [@rafael](#): > > **storage\_free\_capacity\_estimate\_vetted\_bytes**. This metric provides a statistical estimate of the free storage node capacity, but only considering vetted nodes. Does this only count nodes that are fully vetted on ALL satellites? I highly appreciate getting more detailed info via the public API, thank you 🙂 ---
**Author:** ![rafael](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/rafael/32/1122_2.png) [@rafael](https://forum.storj.io/u/rafael)\ **Post date:** [March 9, 2023, 1:54pm UTC](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103/39 "2023-03-09T13:54:53Z")
This only count nodes that are fully vetted **per satellite**. So, **storage\_free\_capacity\_estimate\_vetted\_bytes** for (asia-east-1) AP1 only consider AP1 nodes. [Previous page](https://forum.storj.io/t/publicly-exposed-network-data-official-statistics-from-storj-dcs-satellites/14103.md?page=1)