Empty temp folder automatically

[vladro]

Is it possible to clean up temp folder automatically like its going to happen with trash folder now (i think data can be deleted even after 1 hour of inactivity on daily/weekly basis)

[Alexey]

Normally it should be empty if the node shutdown cleanly.
Files there are not finished uploads, so they can be safely deleted only when the node is stopped.

[vladro]

normally- yep! but when node restarts or power failure or network issue- u should do that manually (by 10-50+ nodes it very inconvenient

[jammerdan]

@vladro

normally- yep! but when node restarts or power failure or network issue- u should do that manually (by 10-50+ nodes it very inconvenient

Yes that is really bad and has been mentioned already in the past:

Temp and Trash folder under storage directory

Hello, the files present on temp and trash folder under storage could be deleted ? Someone are really old about 2-3 years ago

Large temporary folder

Hey my temporary folder is really bloated by the looks of it. Here it is. [storagetemp] Is this at some point maybe going to be removed automatically or should I seek approval from mods as to which files I can remove by myself?

Suggestions have been made:

Large temporary folder

I think that would be an unnecessary overhead. Adding temp folder to the emptying trash process seems like a better idea.

[nerdatwork]

@vladro

10-50+ nodes

Use a powershell script to traverse to your nodes and delete those .partial files.

[vladro]

yep i am doing that way right now :(((

[Alexey]

No, even if it’s restart (not killed), it should remove the temp files.
So, I could assume that you have a lot of uncontrolled restarts (kills)?
If so, this is the time to check your configuration to figure out, why this is happening.

[vladro]

absolutely not s lot, it can happen once/twice in a month maximum:

[nerdatwork]

@Alexey

uncontrolled restarts (kills)?

Wouldn’t unstable internet cause it too ? Intermittent internet disruption could also lead to lot of partial files.

[Toyoo]

@nerdatwork

Wouldn’t unstable internet cause it too ? Intermittent internet disruption could also lead to lot of partial files.

Then the storage node would clean the interrupted files after reporting an error.

[Alexey]

If the node is running it will remove them after timeout or canceling.
So, I guess they should not remain if there were no restarts.

[Alexey]

From this screenshot I may assume, that you have had a force restart on 2024-04-07 and 2024-03-28.
Could you please check what’s caused that?
Because it sounds like an update process have killed it.

[vladro]

03-28- it was node update
04-07- restarted node manually to initiate filewalker

[Alexey]

I see, so, even automatic update killing the node…
I would report this to the team
Also, I would assume that you restarted the node from the Services applet, right?

[Toyoo]

In my case regular restarts wait for all transfers for finish. If it doesn’t, then indeed this looks like a bug. I wonder if it is maybe some case of a timeout, and if transfers are not finished in some period of time, the node is forcibly restarted…

[Alexey]

We recommend a 300 seconds timeout for the docker nodes, however, it’s unlikely supported by the Windows Services Manager…