Bloom filter bonanza?

I’ve watched between 5-10% of my used-space melt away in the last 12h. And it still seems to be ongoing… :chart_decreasing:

Anybody else seeing the same thing? Some serious housekeeping is going on :broom:

2 Likes

I lost about 4TB on all 4 nodes per IP/24

3 Likes

Similar here. Well - perhaps someone big left or get deleted :frowning:

3 Likes

Yeah one of my nodes had 2 “move to trash” events, but since it’s on hashstore couldn’t find it in the logs. It moved ~10% to trash.

According to StorjStats 2PB was removed from the network a few days ago.

3 Likes

Ah, I didn’t think to check the graphs!

1 Like

tangential question, does the hashstore still use the same cadence of receiving a bloom filter and doing deletes like piecesstore does?

I think the BF stuff is exactly the same. But for piecestore the data got moved to the files/config/storage/trash subfolders for a week. And hashstore simply flags it as deleted in the database… and then eventually, based on probability and how much other trash is in a data log file… and if the planets align and Mercury is in retrograde… the data log file will be compacted - basically rewritten without the trash.

But if I have that wrong someone will correct me…

2 Likes

The satellite does not even know whether you’re running on hashstore or piecestore when it sends the bloom filter.

3 Likes

For me, eu satellite has gone to zero. It usually will catch up again.

Edit well it caught up but still total is down

I also see alot of deleted data on my nodes - maybe a big client left the network?

1 Like

No, it’s just the exact same thing that happens every few months: inactive customers > data stored until someone decides it’s no longer needed > data deleted > blooms > deletions > SNOs that got excited seeing their nodes growing and growing and growing for months, devastated by the deletions.

It happened the time before this one, it’s happening this time, and it will continue happening after this time.

4 Likes

But… but… this time was supposed to be different. :money_mouth_face:

1 Like

The Only Golden Rule in Life:
Once, it happens.
Twice is a coincidence.
Thrice is a pattern.

1 Like

Could just as well be another attempt to tune RS parameters.

1 Like

It goes on cheerfully…

1 Like

…oh man you’re right! I thought the deletions were done… but it looks like they started up again about 12h ago.

Wow, my disk trash is almost 30TB now. That’s a new record.

2 Likes

I have not seen a trash explosion yet.

Okay, wow, I’ll bite: what’s your stored data?

It was a bit over 230TB, now down to 216TB

3 Likes

10 subnets, 1.2xTB trash on each.

1 Like