# Seeing customer deleting data over a day and still not stop

**URL:** <https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946>\
**Category:** troubleshooting\
**Tags:** trash, garbage-collector\
**Created:** [April 24, 2024, 12:10am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946 "2024-04-24T00:10:59Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![bebeo92](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/bebeo92/32/7826_2.png) [@bebeo92](https://forum.storj.io/u/bebeo92)\
**Post date:** [April 24, 2024, 12:10am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/1 "2024-04-24T00:10:59Z")

</div>

Like topic title I now seeing my node continue delete/moving data to trash more than a day and still continue doing it, not sure this is a normal behavior

Node is in version 1.101.3

 ![image](https://storj-s3.bcdn.literatehosting.net/original/3X/6/1/61403c3746e20155883914a3aa0d6988c1c80a24.png)

---

<div class="post-metadata">

**Author:** ![arrogantrabbit](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/arrogantrabbit/32/11200_2.png) [@arrogantrabbit](https://forum.storj.io/u/arrogantrabbit)\
**Post date:** [April 24, 2024, 12:42am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/2 "2024-04-24T00:42:56Z")

</div>

Yes, deleting data is normal.

---

<div class="post-metadata">

**Author:** ![bebeo92](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/bebeo92/32/7826_2.png) [@bebeo92](https://forum.storj.io/u/bebeo92)\
**Post date:** [April 24, 2024, 12:54am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/3 "2024-04-24T00:54:22Z")

</div>

yeah but constantly delete over 2 days now …  
I don’t remember seeing this happen before

---

<div class="post-metadata">

**Author:** ![Ambifacient](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/ambifacient/32/7815_2.png) [@Ambifacient](https://forum.storj.io/u/Ambifacient)\
**Post date:** [April 24, 2024, 1:22am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/4 "2024-04-24T01:22:36Z")

</div>

To remove data from your disk, the node needs to check every piece to determine if it should be deleted or kept. If you have a slow hard drive, lots of capacity, using lazyfilewalker, not enough RAM to cache metadata, etc. it can be a long time to do this.

---

<div class="post-metadata">

**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\
**Post date:** [April 24, 2024, 5:06am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/5 "2024-04-24T05:06:45Z")

</div>

Deletion is now performed by an expiration chore (collector) and trash chore, not by customers directly. The deleted data is gathered by a garbage collector (it’s invoked by a Bloom Filter sent from the each satellite) and sent to the trash first, then it will be permanently removed after 7 days. So, yes, removing can take a lot of time on slow disks.

---

<div class="post-metadata">

**Author:** ![bebeo92](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/bebeo92/32/7826_2.png) [@bebeo92](https://forum.storj.io/u/bebeo92)\
**Post date:** [April 24, 2024, 6:06am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/6 "2024-04-24T06:06:44Z")

</div>

Thanks for your information

---

<div class="post-metadata">

**Author:** ![bebeo92](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/bebeo92/32/7826_2.png) [@bebeo92](https://forum.storj.io/u/bebeo92)\
**Post date:** [May 4, 2024, 7:14am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/7 "2024-05-04T07:14:38Z")

</div>

Hi Alexey, I see a problem with this approach now  
So after 7 days, expired data are now being remove from the node but also seeing another round of data moving to trash.  
Combine this 2 things at the same time cause the disk in heavy stress

---

<div class="post-metadata">

**Author:** ![nyancodex](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/nyancodex/32/1129_2.png) [@nyancodex](https://forum.storj.io/u/nyancodex)\
**Post date:** [May 4, 2024, 9:33am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/8 "2024-05-04T09:33:26Z")

</div>

Data deleting is completely normal? you don’t delete your data? However in this case this may come from the saltlake sat, which is test data.

---

<div class="post-metadata">

**Author:** ![bebeo92](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/bebeo92/32/7826_2.png) [@bebeo92](https://forum.storj.io/u/bebeo92)\
**Post date:** [May 4, 2024, 9:46am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/9 "2024-05-04T09:46:51Z")

</div>

I understand data delete is normal, but the way storj is implement I don’t think good for disks  
When they will have to handle both actual data deletion from disk and continue moving data to trash  
Never seeing this behavior before

---

<div class="post-metadata">

**Author:** ![nyancodex](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/nyancodex/32/1129_2.png) [@nyancodex](https://forum.storj.io/u/nyancodex)\
**Post date:** [May 4, 2024, 10:31am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/10 "2024-05-04T10:31:37Z")

</div>

It’s like a backup-plan for them. Sometimes they implement things in the wrong way which makes good data to be deleted, so a “recycle bin” is necessary to recover the data in case of wrong deletion.

---

<div class="post-metadata">

**Author:** ![bebeo92](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/bebeo92/32/7826_2.png) [@bebeo92](https://forum.storj.io/u/bebeo92)\
**Post date:** [May 4, 2024, 10:47am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/11 "2024-05-04T10:47:32Z")

</div>

Yeah but actual delete data from disk and moving data to trash should not happen at same time ?

---

<div class="post-metadata">

**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\
**Post date:** [May 4, 2024, 11:29am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/12 "2024-05-04T11:29:57Z")

</div>

They are async processes not dependent on each other. The trash removal is happening every 24h since the node start, the garbage collection - since the last Bloom Filter received from the satellites.  
So you may place them in a different time interval by the simple restart.

---

<div class="post-metadata">

**Author:** ![bebeo92](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/bebeo92/32/7826_2.png) [@bebeo92](https://forum.storj.io/u/bebeo92)\
**Post date:** [May 4, 2024, 11:44am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/13 "2024-05-04T11:44:14Z")

</div>

Is there a log/setting that indicate trash data remove from disk?  
I just know this happen when I seeing my free disk storage increase

---

<div class="post-metadata">

**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\
**Post date:** [May 4, 2024, 11:56am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/14 "2024-05-04T11:56:39Z")

</div>

Yes, all log entries for each filewalker/chore you can see there:

> [@Filewalker status](https://forum.storj.io/t/filewalker-status/25325/5):
>
> Logs should be at least info level Used space filewalker Task: Calculates disk usage by scanning all pieces and updates the local node databases afterwards with these values docker logs storagenode -f 2\>&1 | grep "used-space-filewalker" | grep -E "started|finished" GC filewalker Task: Based on a [Bloom filter](https://forum.storj.io/t/how-bloom-filters-work/12104/2) it marks pieces as expired for removal by the retain process docker logs storagenode -f 2\>&1 | grep "gc-filewalker" | grep -E "started|finished" Trash-cleanup filewalker Task: Deletes p…

However, some entries could be outdated (I didn’t update the article after the latest change yet), I would appreciate if your could fix them, I made it a wiki.

---

<div class="post-metadata">

**Author:** ![bebeo92](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/bebeo92/32/7826_2.png) [@bebeo92](https://forum.storj.io/u/bebeo92)\
**Post date:** [May 4, 2024, 3:17pm UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/15 "2024-05-04T15:17:28Z")

</div>

Not seeing any log relate to “used-space-filewalker” but see “trash-cleanup-filewalker” so update your note with that

---

<div class="post-metadata">

**Author:** ![nyancodex](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/nyancodex/32/1129_2.png) [@nyancodex](https://forum.storj.io/u/nyancodex)\
**Post date:** [May 4, 2024, 10:56pm UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/16 "2024-05-04T22:56:54Z")

</div>

check your log level in config?

---

<div class="post-metadata">

**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\
**Post date:** [May 5, 2024, 2:55am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/17 "2024-05-05T02:55:33Z")

</div>

`used-space-filewalker` is running only on start, if you didn’t disable it.

---

<div class="post-metadata">

**Author:** ![bebeo92](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/bebeo92/32/7826_2.png) [@bebeo92](https://forum.storj.io/u/bebeo92)\
**Post date:** [May 5, 2024, 3:48am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/18 "2024-05-05T03:48:30Z")

</div>

make sense, I’m not disable it  
also, Is there any public link to sample config.yaml that contain all the setting with explain what setting will do?

---

<div class="post-metadata">

**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\
**Post date:** [May 5, 2024, 4:06am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/19 "2024-05-05T04:06:11Z")

</div>

No and unlikely will be, it’s constantly changes, we cannot keep it updated so it will be always outdated.  
But you may run this command to get all parameters and their defaults:

## docker

```auto
docker exec -it storagenode ./storagenode setup --help

```

Please note, in the docker setup you will pass most of needed parameters directly in your `docker run` command, not in the `config.yaml` file, because command line arguments have a precedence above parameters in the `config.yaml` file.

## PowerShell and Windows GUI:

```auto
& "$env:ProgramFiles\Storj\Storage Node\storagenode.exe" setup --help

```

You may also take a look on (but it’s likely outdated already):

> [@Config.yaml - Linux/Docker all parameters](https://forum.storj.io/t/config-yaml-linux-docker-all-parameters/24850):
>
> This is the default config.yaml made by storagenode Docker installer in Linux. Let’s try to keep this up-to-date with all new parameters added or removed with new storagenode versions. Everytime I will start a new node, I will post here the newest config.yaml. Note by mitsos: The forum no longer allows for two versions to be kept, so only the last version is shown. Hidden options to enable storage2.monitor.dedicated-disk: true storage2.monitor.reserved-bytes: 100 GB Version 1.142 (identical …

---

<div class="post-metadata">

**Author:** ![snorkel](https://storj.bcdn.literatehosting.com/letter_avatar/snorkel/32/6_449c533f586939b6e5f246632a46421f.png) [@snorkel](https://forum.storj.io/u/snorkel)\
**Post date:** [May 5, 2024, 5:54am UTC](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946/20 "2024-05-05T05:54:28Z")

</div>

Yep, it’s a wiki, but I can’t update it on every version, only when I start a new node, which is rare, or start a new node just to get the config, and remove it, which I don’t do, or when others contribute.

[Next page](https://forum.storj.io/t/seeing-customer-deleting-data-over-a-day-and-still-not-stop/25946.md?page=2)
