Generic update:
- We are planning to use max ~4 Mbyte bloom filters from today or tomorrow (first on SLC/AP)
That’s not the optimal for very big nodes, bust based on the simulation it’s enough to start shrinking the unnecessary data. Full shrinking requires more GC period (=more weeks), which also useful, as trash can be processed meantime, and is not necessary to delete everything in one round.
Bigger bloom filter requires protocol changes (this, and few more patches)
https://review.dev.storj.io/c/storj/common/+/12353
That’s a long term solution as requires full rollout.
Also, two more metrics are added (satellite_usage/blobs_usage), and will be available from 1.98:
These can be used to monitor locally the space usage reported by storagenode and satellite, and you can also compare it.
If you telemetry is enabled, the data will be received by us, and we can be alerted by big discrepancies (and monitor the shrinking process).