Why is used space slowly but surely decreasing?

[raert]

For an experiment I changed the storage.allocated-disk-space to be below the total used, and without any customer data being deleted (so latest GC run is 0, trash is 0), the used space is very slowly, but surely decreasing. Why?
(the used space value is coming straight from the storagenode binary’s prometheus metric: used_space{field=“recent”})

[Krawi]

Expiration dates for some pieces set and reached?

[nerdatwork]

I thought so too but expired pieces are collected by GC. OP mentions GC is zero.

[snorkel]

If the pieces are there, than maybe a bug in mon kit or in the file walker.

[Toyoo]

Expired pieces can be deleted both by GC and by a dedicated service, storagenode/collector/service.go.

[Alexey]

Depends on the expiration type. The customer may set an expiration date during upload, it will be deleted by the other service. The remained can be collected by the Garbage Collector.

@raert please search in logs for expired.

[nerdatwork]

I understand. I looked at the code given by @Toyoo. There is a a “package collector service” that runs every hour while there is retain service aka GC that collects garbage data. IIRC GC runs every 5 days.

[Alexey]

You may use a logrotate binary

How to create daily storagenode logs

are you running in a NAS or Windows or Linux? In Ubuntu I use the “logrotate” command in a cron job to create/compress log files. First you have to make sure you have added in the “Log Location” and “Log level” fields in the “config.yaml” Then look in the “/etc/logrotate.d/” folder, you’ll see a list of files, those are the configs used to rotate logfiles ( usually found in “/var/log/”). I just put a “storj” config file in the logrotate.d/ and it’s done automatically To rotate my logs i use …

or this script:

Native logs rotation in Windows with a simple PowerShell script

Hello, Unfortunately, in the current windows version of the Storage Node there is no way to rotate or limit the size of the generated logs files. You cannot delete them from the GUI because they are locked by the services processes. Using Clear-Content in PowerShell to reset the files works but there is no easy solution if you want to keep a few days / weeks of logs. I have written a small PowerShell script that can rotate the Storjs Logs without the need of Stop>Start the services to release …