In my trash folder I can see files from slc deleted after only some days. How is this possible, shouldn’t it have 30 days TTL?
The people over here seem to be hot-on-the-trail of an issue that’s causing some data to seemingly not be recorded in the TTL database. So it’s not getting deleted on its TTL date… and instead sticks around longer to slowly be taken out as regular trash.
I think littleskunk has a script to see if the same thing may be happening on your node.
1 Like
Have a look at the file date. Given the fact that bloom filters come with a delay those files must have been deleted immediately after creation. Or they never made it to the satellite database… 
If that piece has not being recorded to the TTL database, it will be collected by the garbage collector. The satellite sends a BF with pieces that the node must keep. So these extra pieces will be deleted eventually.
1 Like
Do you have the logs for when you received those recent pieces? Perhaps you can do a search on the piece ID. I’d be curious to see if they were logged as regular uploads or cancelled uploads or something else.
1 Like
Files have been deleted by bloom filter one week after creation. So your answer doesn’t make sense to me. Please explain what I missed.
Heh, we (the Community) suspect that not all TTL data is recorded to the TTL database, as it should. We do not have enough evidences or a clue so far… but, some numbers doesn’t match. Like the number of successful uploads from the Saltlake’s customers and the number of records in the TTL database. Which is mean, that some TTL data is not recorded as a TTL data.
As a result, this data will not be deleted after the expiration right away, but will be collected by the garbage collector and will be finally removed after 7 days in the trash folder.
2 Likes
Had a day offline because moving, naturaly trash was pumped into TB range.
are the records to stay longer than the trash(blobs on disk) into the database?
(how get outdated lines in the database removed? is the database scanned/vacuumed for something like that? or do i have it to do myself?)
so its more records than files with ttl? or vice versa?
At this time, you do not need to delete records from the TTL database, they are deleted automatically. And so far it’s confirmed that expired data is actually deleted too.
The current observed difference between the Saltlake satellite client uploads and the TTL database records for the expected expiration range shows that we have fewer TTL records than we should have.
See
Maybe some sno deleted the database because of errors.?
1 Like
Yes, but not me and not @ littleskunk.