Current situation with garbage collection

Hopefully they’ll tune the capacity-reservation uploads to be relatively smooth: so we reach a steady-state of uploads+deletes most days. Because you’re right: if our bursty ingress inevitably results in days with massive deletes… the tears will be legendary! :wink:

No matter what Storj does… someone will come here to complain… even if it’s making them money…

Meanwhile I checked my incoming test data. It seems to be always 30 day TTL, so this will disapear at the same speed it is coming in.

Why would they? Nobody will expect this kind of tuning from regular customers.

Capacity-reservation ingress isn’t performance-testing or customer-workload simulation. It’s the least-impactful way to keep space saved. The easiest way to do that is to upload at a slow constant rate: so each day the same amount of TTL data is deleted as is uploaded.

Why would they upload at anything above the bare-minimum rate? It would just be stealing potential performance from paying customers… and SNOs complain more as upload+deletes become more variable.

The same as usual - do, please, nothing.
You do not need to change anything. The short message - “do not do anything, unless you are sure about taxes”.

To show these potential customers for whom these reservations are made that specificaly their use case will be fast enough.

1 Like

I didn’t want to do anything, I just wanted to make sure that no filters were sent or that I didn’t receive them for some reason because the HDD is already very busy with the tests

Summary


You need only to make sure, that your logs doesn’t contain errors, related to blobs, i/o, trash and order(s).

If? It’s a certainty!

Unfortunately at least for me not all the test data has TTL.
So again unpaid test data for at least 8 days…

2024-06-09T09:43:54.643288481+02:00 2024-06-09T07:43:54Z	INFO	lazyfilewalker.trash-cleanup-filewalker	starting subprocess	{"Process": "storagenode", "satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE"}
2024-06-09T09:43:54.645576211+02:00 2024-06-09T07:43:54Z	INFO	lazyfilewalker.trash-cleanup-filewalker	subprocess started	{"Process": "storagenode", "satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE"}
2024-06-09T09:43:54.655697394+02:00 2024-06-09T07:43:54Z	INFO	lazyfilewalker.trash-cleanup-filewalker.subprocess	trash-filewalker started	{"Process": "storagenode", "satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Process": "storagenode", "dateBefore": "2024-06-02T07:43:54Z"}
2024-06-09T09:43:54.659421002+02:00 2024-06-09T07:43:54Z	INFO	lazyfilewalker.trash-cleanup-filewalker.subprocess	Database started	{"Process": "storagenode", "satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Process": "storagenode"}
2024-06-09T09:44:36.483991744+02:00 2024-06-09T07:44:36Z	INFO	lazyfilewalker.trash-cleanup-filewalker.subprocess	trash-filewalker completed	{"Process": "storagenode", "satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Process": "storagenode", "bytesDeleted": 131686079232, "numKeysDeleted": 232076}
2024-06-09T09:44:36.593145688+02:00 2024-06-09T07:44:36Z	INFO	lazyfilewalker.trash-cleanup-filewalker	subprocess finished successfully	{"Process": "storagenode", "satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE"}

A post was split to a new topic: Orders are not sending for US1

It seems like my nodes didn’t receive any bloom filter since 2024/06/06. Is there a new problem I missed?

You aren’t alone. I have noticed the same thing.

2 hours ago I have seen that the team noticed it and is working on it. It looked like the DB backup job didn’t run for some reason. I would call that a normal hickup. Should get resolved soon.

5 Likes

If it starts hickup-ing like a baby, just apply the old universal panaceum… :facepunch:t4:

Are you serious? I have never heard or felt such a “panacea” :astonished: (I’m Russian. Ok. Born in Russia, it doesn’t matter, such a perversion has never been applied to me, you know, words are somehow more painful… for me anyway).

2 Likes

:rofl::rofl::rofl: it was a joke. I was thinking to movie Armagedon (I believe), when the russian guy hits the computer of the space shuttle and fixes it. :rofl:
I didn’t ment russians hit their babies. :sweat_smile:

fuf. Because if that’s would be true… uh. I will greatly sympathize with relatives and friends (especially their children) if this were true…