Disk usage discrepancy?

[Alexey]

Not all, only the used space filewalker. The gc-filewalker is running 1-2 times per week and initiated by satellites, the piece:trash is running every 24h since start, the collector running every hour, and so on.
See

Storagenode.exe stopping for too long, for 10h+

Windows/PowerShell Logs should be at least info level Used space filewalker Regulated by the parameter in the config.yaml file or as a command line argument (add -- before the parameter, remove :, place it after the image name in your docker run command): # if set to true, all pieces disk usage is recalculated on startup (default true) storage2.piece-scan-on-startup: true to watch for a progress: cat "C:\Program Files\Storj\Storage Node\*.log" -Wait | sls "used-space-filewalker" | sls "sta…

[naxbc]

Indeed, @Alexey.
Funny enough it’s happening on my oldest 3 windows nodes.
Log is in info, I even pasted a link over 1GB of log file.

[Alexey]

I saw the link, but my tablet is unable to process it… So, I would ask you to search for a few lines which contains “walk” and “started|finished” or “failed|error” with the provided scripts.

[naxbc]

Ok, there´s new information about it but it looks odd as well as it seems the process finished but data is not accurate anyway!

A few errors as well:

[nerdatwork]

@naxbc

data is not accurate anyway!

Check disk for errors.

[naxbc]

I have also apparently errors in “pieceexpiratiodb”…

[nerdatwork]

Context canceled for dbs indicate slow drive. The entry for that piece will be deleted later. Currently try to chkdsk your drive.

[daki82]

@naxbc After chkdsk (i do not remember if already checked,)
How many folders are in blobs?
Is the temp folder not full of files older 3 days?

If already checked, i apologise for asking.

[naxbc]

No problem.
I started full CHKDSK /F and it will take a while as my drive is 16TB.
I’ll post the results when it finishes and let you know about the blobs.
Thank you for the feedback.

[Walter1]

For some nodes I also have the WARN-message “retain failed to delete piece”

Can some advice what to do?

It is also context cancelled:

Running on Debian Linux, no RAID, just plain ext4 Enterprise CMR HDD.

The data-bases are on a SSD and other nodes with data-bases also on the SSD are working fine.

[Knowledge]

Hi Walter1

See here…

Node hang when received "WARN retain failed to delete piece" warning message

This warning mean that the node cannot access a database file. I would suggest to stop and remove the container, then check and fix the filesystem, after that check and fix databases If you would not like to fix corrupted databases (if you have the corruption), you may also re-create only corrupted instead, but you will lose the historic and Stat data: If they are not broken, you do not need to fix them though. However, the node will not stop because of warning. You need to search for FATA…

[naxbc]

Finally finished @daki82

Blobs folder:

Temp folder is actually full of files from 2023

[daki82]

Ok. Here we are. The temp is spammed and you have 3 blobs folders to much.

1. Easy.
   Stop the node, wait 1 min. Then empty temp.
2. How To Forget Untrusted Satellites - #57 by daki82

This will remove 2 sats. Alter the paths to your setup.
May take days.
Find out the 3. Not needed blobs name. It may be the old stefanbenten. The info is here somewhere.

Dont have time for more…gl

[naxbc]

Thanks man, that´s awesome info
@Alexey where can I find the list of trusted sattelites? Shouldn´t this information be applied to new releases?
All this caused a discrepancy of almost 2TB!!!

[nerdatwork]

@naxbc

where can I find the list of trusted sattelites?

https://www.storj.io/dcs-satellites

[Roberto]

Satellite info (Address, ID, Blobs folder, Hex)

I noticed one of my responses in an old topic being linked to quite frequently listing this info. I figured it might be a good idea to post it in an easier to find place where I can also keep it up to date. Active satellites Customer facing Satellite Address: ap1.storj.io:7777 (formerly: asia-east-1.tardigrade.io:7777) Satellite ID: 121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6 Sat.ID hex: 84A74C2CD43C5BA76535E1F42F5DF7C287ED68D33522782F4AFABFDB40000000 Blobs Folder: qstuylguhrn2ozjv4h…

[Alexey]

It’s a wiki a long time ago?

[Roberto]

sorry, I linked wrong

[naxbc]

Hi @daki82 it definitely helped but I´m still 1TB short…any more ideas or suggestions? @Alexey?

[daki82]

I have one idea to check:

The windows trash bin configuration for the drive. it should say: no trash, delete files directly.

Right click on the recycle bin icon,Properies of the windows trash bin. click on the drive e: