How long does trash stay before getting deleted?

[Eleos]

I believe my trash has been the same for what seems like more than 7 days so does it stay for longer in any case? Can I check how long it’s been stored?

[bre]

Hi @Eleos ,

Trash should remain for only 7 days.

If you are seeing trash for longer than 7 days, can you please provide some evidence for the team to review?

[Eleos]

I’m not sure if it’s been there for more than 7 days or not, I may just be mistaken the timeframe. Is there a way to check how long it’s been there?

[bre]

You can try to search the logs for collector

Logging behind trash / delete explained

Try to search for deleted expired piece in your logs. You may see all logs from the collector too - search for collector.

[Eleos]

I ran this command and got the following along with the sat id and deleted piece id for each count item. The number changes randomly and keeps going forever though.

sudo docker logs storagenode | grep “collector”

Result:

collect {“process”: “storagenode”, “count”: 458}

[Alexey]

For bash:

Unaccounted data is stored in the trash

find /mnt/storj/storagenode/storage/trash/ -mtime +7 -type f -exec du --block-size=1000 '{}' ';' | awk '{total+=$1; count++}END{print "TOTAL", total/1000, "MB\n" "count", count}'

For Windows PowerShell:

Trash displays too low a value

PowerShell: Get-ChildItem z:\Node-3\Storage\trash\ -File -Recurse | Where-Object {$_.LastWriteTime -lt (Get-Date).AddDays(-7)} | Measure-Object -Property Length -Sum | %{"Total {0:f2} MB`ncount {1}" -f ($_.Sum/1e6), $_.Count} You may check that you do not have anything older than 7 days: Get-ChildItem z:\Node-3\Storage\trash\ -File -Recurse | Where-Object {$_.LastWriteTime -lt (Get-Date).AddDays(-8)} | Measure-Object -Property Length -Sum | %{"Total {0:f2} MB`ncount {1}" -f ($_.Sum/1e6), $_.C…

[Eleos]

Using bash with modified command for /mnt location:

TOTAL 0 MB
count

Dashboard trash reports:

199.36MB

[Alexey]

I provided a command to see do you have pieces older than 7 days.
If you just want to see how much it takes in total, you need to use an du -s --si /mnt/storj/storagenode/storage/trash command instead, where /mnt/storj/storagenode is a path to your data location.

The information on the dashboard is taken from the databases. So if your databases are ok (you may check that: https://support.storj.io/hc/en-us/articles/360029309111-How-to-fix-a-database-disk-image-is-malformed), then you probably have issues with filewalkers or the used-space-filewalker is disabled (it’s enabled by default). If you have errors related to any of filewalkers (search for walk|retain|trash and error|failed|ERROR), then I would suggest to enable a used-space-filewalker on startup and disable a lazy one:

@jeremyfritzen

storage2.piece-scan-on-startup: true
pieces.enable-lazy-filewalker: false

and then wait for 2 weeks

Do not forget to save the config and restart the node.

[Eleos]

Oh okay I see. The second command reports: 207M