# Disk usage discrepancy?

**URL:** <https://forum.storj.io/t/disk-usage-discrepancy/24715>\
**Category:** troubleshooting\
**Tags:** xfs, btrfs, ntfs, storage, zfs\
**Created:** [December 19, 2023, 6:18pm UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715 "2023-12-19T18:18:00Z")\
**Posts on this page:** 20\
**Page:** 12

<div class="post-metadata">

**Author:** ![JWvdV](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/jwvdv/32/7814_2.png) [@JWvdV](https://forum.storj.io/u/JWvdV)\
**Post date:** [February 2, 2024, 7:18pm UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/257 "2024-02-02T19:18:23Z")

</div>

Depending on the speed of your drive, but it might take days before the filewalker finished.

---

<div class="post-metadata">

**Author:** ![naxbc](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/naxbc/32/1125_2.png) [@naxbc](https://forum.storj.io/u/naxbc)\
**Post date:** [February 2, 2024, 7:35pm UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/258 "2024-02-02T19:35:58Z")

</div>

It’s a 7200rpm 16TB HDD.  
Any prediction a bit more accurate?

---

<div class="post-metadata">

**Author:** ![JWvdV](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/jwvdv/32/7814_2.png) [@JWvdV](https://forum.storj.io/u/JWvdV)\
**Post date:** [February 2, 2024, 7:40pm UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/259 "2024-02-02T19:40:30Z")

</div>

Rather days than hours, but not a week.  
It all depends on whether PC isn’t being restarted in time between, no storagenode updates, the real amount of files on your node, …

What file system are you using BTW?

---

<div class="post-metadata">

**Author:** ![daki82](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/daki82/32/1128_2.png) [@daki82](https://forum.storj.io/u/daki82)\
**Post date:** [February 2, 2024, 8:37pm UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/260 "2024-02-02T20:37:17Z")

</div>

@naxbc  
fsutil fsinfo ntfsinfo E:

copy this in the admin shell. press enter. post the screenshot(output). Please.

And welcome back.

---

<div class="post-metadata">

**Author:** ![naxbc](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/naxbc/32/1125_2.png) [@naxbc](https://forum.storj.io/u/naxbc)\
**Post date:** [February 2, 2024, 8:44pm UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/261 "2024-02-02T20:44:54Z")

</div>

It’s NTFS on a Ryzen 7 with 32GB RAM.

---

<div class="post-metadata">

**Author:** ![naxbc](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/naxbc/32/1125_2.png) [@naxbc](https://forum.storj.io/u/naxbc)\
**Post date:** [February 2, 2024, 9:07pm UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/262 "2024-02-02T21:07:44Z")

</div>

> [@daki82](#):
>
> fsutil fsinfo ntfsinfo E:

![image](https://storj-s3.bcdn.literatehosting.net/original/2X/5/545678244d0ace017e4f3b78788b14a465d5b5aa.png)

---

<div class="post-metadata">

**Author:** ![JWvdV](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/jwvdv/32/7814_2.png) [@JWvdV](https://forum.storj.io/u/JWvdV)\
**Post date:** [February 2, 2024, 11:23pm UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/263 "2024-02-02T23:23:50Z")

</div>

That looks fine… So only seems to be an unfinished file walker.

---

<div class="post-metadata">

**Author:** ![Roxor](https://storj.bcdn.literatehosting.com/letter_avatar/roxor/32/5_5575768a8748004e209b776fc1b2916d.png) [@Roxor](https://forum.storj.io/u/Roxor)\
**Post date:** [February 3, 2024, 1:16am UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/264 "2024-02-03T01:16:33Z")

</div>

I’d love to hear the average times for other peoples start-time filewalkers. Does 4h/used-TB sound reasonable? So if OP has around 9TB filled that would mean ~36 hours?

---

<div class="post-metadata">

**Author:** ![snorkel](https://storj.bcdn.literatehosting.com/letter_avatar/snorkel/32/5_5575768a8748004e209b776fc1b2916d.png) [@snorkel](https://forum.storj.io/u/snorkel)\
**Post date:** [February 3, 2024, 3:35am UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/265 "2024-02-03T03:35:19Z")

</div>

I posted my fw run times. See Tuning the filewalker.

---

<div class="post-metadata">

**Author:** ![HotDrive](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/hotdrive/32/7829_2.png) [@HotDrive](https://forum.storj.io/u/HotDrive)\
**Post date:** [February 3, 2024, 10:24am UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/266 "2024-02-03T10:24:43Z")

</div>

And, after 15 days, I get these lovely numbers…

 ![Nova imagem](https://storj-s3.bcdn.literatehosting.net/original/2X/9/9a494bd860fa40881162db1fb6e771861a80a23e.jpeg)

---

<div class="post-metadata">

**Author:** ![daki82](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/daki82/32/1128_2.png) [@daki82](https://forum.storj.io/u/daki82)\
**Post date:** [February 3, 2024, 12:12pm UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/267 "2024-02-03T12:12:33Z")

</div>

Maybe we wait for the bigger Bloom-filters, fix is on the way.  
Plus improved solution for the future is planned.

---

<div class="post-metadata">

**Author:** ![HGPlays](https://storj.bcdn.literatehosting.com/letter_avatar/hgplays/32/5_5575768a8748004e209b776fc1b2916d.png) [@HGPlays](https://forum.storj.io/u/HGPlays)\
**Post date:** [February 3, 2024, 12:38pm UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/268 "2024-02-03T12:38:33Z")

</div>

Even after forgetting untrusted satelites i still have a hugh issue with disc discrepancy:  
windows reported use:  
 ![image](https://storj-s3.bcdn.literatehosting.net/original/2X/1/1c6b63d1d3bd7cc7201b803648a781f97ae74709.png)

dashboard:

 ![image](https://storj-s3.bcdn.literatehosting.net/original/2X/f/f3bc4f92eaf28d6509229a66873a0229f6ec407a.jpeg)

---

<div class="post-metadata">

**Author:** ![theyosh](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/theyosh/32/1134_2.png) [@theyosh](https://forum.storj.io/u/theyosh)\
**Post date:** [February 3, 2024, 10:24pm UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/269 "2024-02-03T22:24:39Z")

</div>

Hi, I do see a bigger difference. My node is full for at least 2 months at 12 TB +/- 0.5G free and trash.

But yet, the average disk space used is staying at 10TB. So that is a 2TB difference.

 ![image](https://storj-s3.bcdn.literatehosting.net/original/2X/2/2657b54a0e9dd2a5c336961ed08a9eca9bd5e246.png)

I have a xfs file system. Not sure if that is causing this. But I can only think of small files being stored. Where the average is calculated by the satellites, I guess based on file size.  
So when there are a lot of small files, it can eat up my storage sectors on disk and not filling all sectors due to the disk block size. So I am loosing space on my disks. Which would be a shame, but nothing Storj can do about it.  
But at least I would like to know if that could explain the difference between the two values. Sounds placeble?

---

<div class="post-metadata">

**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\
**Post date:** [February 4, 2024, 3:58am UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/270 "2024-02-04T03:58:09Z")

</div>

```auto
2024-01-24T22:28:33Z INFO lazyfilewalker.gc-filewalker.subprocess gc-filewalker started {"process": "storagenode", "satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "process": "storagenode", "createdBefore": "2024-01-17T17:59:59Z", "bloomFilterSize": 2097155}
2024-01-25T03:20:07Z INFO lazyfilewalker.gc-filewalker subprocess finished successfully {"process": "storagenode", "satelliteID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"}

2024-01-25T19:42:34Z INFO lazyfilewalker.gc-filewalker.subprocess gc-filewalker started {"process": "storagenode", "satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "createdBefore": "2024-01-21T15:26:55Z", "bloomFilterSize": 364960, "process": "storagenode"}
2024-01-25T19:49:13Z INFO lazyfilewalker.gc-filewalker subprocess finished successfully {"process": "storagenode", "satelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE"}

2024-01-26T14:58:04Z INFO lazyfilewalker.gc-filewalker.subprocess gc-filewalker started {"process": "storagenode", "satelliteID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6", "process": "storagenode", "createdBefore": "2024-01-22T17:59:58Z", "bloomFilterSize": 574785}
2024-01-26T15:31:29Z INFO lazyfilewalker.gc-filewalker subprocess finished successfully {"process": "storagenode", "satelliteID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6"}

2024-01-28T08:29:37Z INFO lazyfilewalker.gc-filewalker.subprocess gc-filewalker started {"process": "storagenode", "satelliteID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "process": "storagenode", "createdBefore": "2024-01-23T17:59:59Z", "bloomFilterSize": 1877458}
2024-01-28T12:25:18Z INFO lazyfilewalker.gc-filewalker subprocess finished successfully {"process": "storagenode", "satelliteID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs"}

```

| Satellite ID | Used space | Time |
| --- | --- | --- |
| `12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S` | 2.18TB | 4h 52m |
| `1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE` | 1.24TB | 0h 7m |
| `121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6` | 645.58GB | 0h 33m |
| `12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs` | 2.77TB | 3h 56m |

So, for me it sounds like 1h23m/TB

---

<div class="post-metadata">

**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\
**Post date:** [February 4, 2024, 4:01am UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/271 "2024-02-04T04:01:37Z")

</div>

Did all filewalkers finish their jobs for all satellites? Or do you still have errors related to them or FATAL errors?

---

<div class="post-metadata">

**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\
**Post date:** [February 4, 2024, 4:04am UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/272 "2024-02-04T04:04:22Z")

</div>

Is it exFAT? Because 4.57TB cannot use almost 9TB  
Also, do you have errors related to filewalkers?

---

<div class="post-metadata">

**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\
**Post date:** [February 4, 2024, 4:08am UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/273 "2024-02-04T04:08:33Z")

</div>

In this thread we discussing disk discrepancies on nodes, where disk is not able to keep up and lazy filewalkers are failing to finish their job.  
So, please check your logs for errors related to filewalkers (search for `"walk|retain"` and `"failed|error"`), also search for `FATAL` errors.

---

<div class="post-metadata">

**Author:** ![theyosh](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/theyosh/32/1134_2.png) [@theyosh](https://forum.storj.io/u/theyosh)\
**Post date:** [February 4, 2024, 9:37am UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/274 "2024-02-04T09:37:21Z")

</div>

My bad. Will search further

---

<div class="post-metadata">

**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\
**Post date:** [February 4, 2024, 10:07am UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/275 "2024-02-04T10:07:48Z")

</div>

No problem at all. Just add what you have done so far.

---

<div class="post-metadata">

**Author:** ![HotDrive](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/hotdrive/32/7829_2.png) [@HotDrive](https://forum.storj.io/u/HotDrive)\
**Post date:** [February 4, 2024, 2:52pm UTC](https://forum.storj.io/t/disk-usage-discrepancy/24715/276 "2024-02-04T14:52:59Z")

</div>

No. Even after 15 days, some were still running. Either way, no errors nor FATAL regarding any on them. I’ve restarted my node with lazy disabled to see how it goes. Now, my numbers are even worse, and disk usage increased…

 ![Nova imagem](https://storj-s3.bcdn.literatehosting.net/original/2X/c/c17322a49c6c6c95c87e59137f74e91c5ecdb92c.jpeg)

[Previous page](https://forum.storj.io/t/disk-usage-discrepancy/24715.md?page=11)

[Next page](https://forum.storj.io/t/disk-usage-discrepancy/24715.md?page=13)
