Data Cleanup Plan

Hello Node Operators and Community Members,

We are implementing a new process to remove data from accounts with outstanding bills and violations of our terms and conditions. Historically, we refrained from doing this out of an abundance of caution, hoping those customers would eventually return and settle their balances. However, these delinquent accounts have accumulated, and it is now time to address the issue with a comprehensive cleanup.

As part of this effort, we have identified that this will have a notable impact on the EU1 satellite, where over 1 PB of data will be removed. We wanted to inform you of this as we proceed with the cleanup.

Thank you,
The Storj Team

27 Likes

Sounds like a solid business decision. If the customers aren’t paying their bills for space… but Storj is still paying the SNOs for space, that has to stop.

Bring on the armageddon-EU1-bloom-filters! :sparkler: :fire:

4 Likes

As of today

1 Like

So around 10-15% of EU1 should disappear? Wow!

Wow 1PB. Is this like a couple of big accounts or many smaller accounts accumulated over the years?

My guess is… if we know there are a huge number of Storj nodes now in that geo… there were probably a huge number of Chia nodes as well: and there was a time when it was profitable to at least try to farm Chia on S3 storage.

When Chia became unprofitable: those users probably abandoned their accounts full of plot files and just stopped paying the bills.

Like I said, a guess. But that type of usage could have easily chewed up a PB.

BTW: I noticed a similar 1 PB drop back in december but can’t remeber any announcement… :thinking:

Do you have a link? Because in November-December 2024 there was a migration of AP1 and EU1 satellites to a new database backend, so some data could be missing for some period, but later it should have been recovered.

I remember a 1 PB drop on december 21 for US1.

It is also visible here: Grafana

Seems you didn’t specify the date range, so… I do not see a big drop.
What’s available on that link is just a confirmation of what’s I’m saying - there was no stat data during migration…

So, seems not a big deletion, just missing statistics data…

Perhaps it’s this (drops from 28.1 to 27TB):

Storj Network Statistics - Grafana

EU1 ~ Dec 20th

Yes, I mean this drop. But Satellite selection on this site is not working, 28 PB is obviously the entire network. In fact the drop was on US1.

The announcement was made a few days ago. So the earliest drop we will see is in 7 days, if we will receive a bloom filter. Or am I wrong?

I think if the satellite wouldn’t miss the window, then BF would arrive earlier.

Looks like missing stat, because later it recovered even bigger.

It recovered very slowly over one month or so. This looks like a real loss to me which only recovered because of normal growth. Maybe a big customer who left end of the year?

No Problem with the many new PB-Customers in Pipeline promised the last year /s

Sorry to be sarcastic, but thats another Bad News for the SNO in the Public Network.
I see no growth for the last year, except the select-Network (maybe).

Sad because it’s a nice project and an Impressive Technology the Team created.

3 Likes

Select is included in US1 stats. So not that impressive either.

2 Likes

Petabytes? Zettabytes!!!

https://www.storj.io/blog/vars–rethink-your-cloud-storage-lineup-for-financial-gains

Companies produce hundreds of zettabytes of data annually…that’s zettabytes . Storing and managing it affordably is becoming a major concern. In a recent Virtana survey, 54% of IT leaders said their cloud storage costs were rising faster than other cloud costs.

So where are they:

Instead of 1 PB growth we gonna see another PB purge from the public network. :nauseated_face::face_vomiting:

4 Likes

Just to be clear the “over 1 PB of data” is customer data, meaning that you have to expand that by ~2 to be in the same units as the dashboard.

1 Like