# Repair node feature -download missing files

**URL:** <https://forum.storj.io/t/repair-node-feature-download-missing-files/10936>\
**Category:** Ideas & Suggestions\
**Tags:** storagenode\
**Created:** [December 30, 2020, 5:36pm UTC](https://forum.storj.io/t/repair-node-feature-download-missing-files/10936 "2020-12-30T17:36:15Z")\
**Posts on this page:** 12\
**Page:** 1

<div class="post-metadata">

**Author:** ![paveldvorak](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/paveldvorak/32/1125_2.png) [@paveldvorak](https://forum.storj.io/u/paveldvorak)\
**Post date:** [December 30, 2020, 5:36pm UTC](https://forum.storj.io/t/repair-node-feature-download-missing-files/10936/1 "2020-12-30T17:36:15Z")

</div>

Hi,  
I had a HDD failure and I lost few percents of the files. I had replaced my drive a month ago but my storage node audit score is still low because of this.  
I would like a command to re-download missing files and delete obsolete files. My storage has 8TB but only few GB are lost.  
Thanks

---

<div class="post-metadata">

**Author:** ![kevink](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/kevink/32/6077_2.png) [@kevink](https://forum.storj.io/u/kevink)\
**Post date:** [December 30, 2020, 6:55pm UTC](https://forum.storj.io/t/repair-node-feature-download-missing-files/10936/2 "2020-12-30T18:55:29Z")

</div>

> [@Ability to recover part of lost data / restore the node from backup](https://forum.storj.io/t/ability-to-recover-part-of-lost-data-restore-the-node-from-backup/6855):
>
> Bad stuff can happen. A single 10TB drive can develop a few bad sectors, there could be a power failure that corrupts the database and so on. Nothing is perfect. However, under the current rules, losing a bit of data means I have to delete the rest of the data and start over. This looks like a disproportionate response - the database got corrupted somehow etc and now I have to wait a year for my node to fill back up etc. Especially since there were cases where nodes got disqualified because of…

Apart from that: your node might survive losing a few GB from 8TB.

---

<div class="post-metadata">

**Author:** ![paveldvorak](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/paveldvorak/32/1125_2.png) [@paveldvorak](https://forum.storj.io/u/paveldvorak)\
**Post date:** [December 30, 2020, 10:50pm UTC](https://forum.storj.io/t/repair-node-feature-download-missing-files/10936/3 "2020-12-30T22:50:26Z")

</div>

Well, the node survived, that’s not the point  
In the other thread, he talks about restoring from a backup, that’s nonsense. I make no sense to make backup of a node that makes you few bucks.  
I’m thinking about re-downloading the files a perhaps a command to tell the satellite that some files are no longer available.

---

<div class="post-metadata">

**Author:** ![Pac](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/pac/32/6053_2.png) [@Pac](https://forum.storj.io/u/Pac)\
**Post date:** [December 30, 2020, 10:59pm UTC](https://forum.storj.io/t/repair-node-feature-download-missing-files/10936/4 "2020-12-30T22:59:21Z")

</div>

This has been discussed several times throughout the forum, but in short the answer is that it’s not worth it from a satellite point of view… So I’m not sure we’ll ever see such a feature.

---

<div class="post-metadata">

**Author:** ![Vadim](https://storj.bcdn.literatehosting.com/letter_avatar/vadim/32/6_449c533f586939b6e5f246632a46421f.png) [@Vadim](https://forum.storj.io/u/Vadim)\
**Post date:** [December 30, 2020, 11:00pm UTC](https://forum.storj.io/t/repair-node-feature-download-missing-files/10936/5 "2020-12-30T23:00:49Z")

</div>

restoring data is very expencive process. sattelite need to download pieses, pay for downloading it, them remake file, new 80 parts or how many is needed that it together will be 80 and send it to holders.  
and all this trafic has to be payd. I mean not only to SNO but to server owner that also want money for outgoing trafic.

---

<div class="post-metadata">

**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\
**Post date:** [December 31, 2020, 12:12pm UTC](https://forum.storj.io/t/repair-node-feature-download-missing-files/10936/6 "2020-12-31T12:12:47Z")

</div>

The similar idea is discussed there:

> [@Storage node to Satellite : I've lost this block, sorry](https://forum.storj.io/t/storage-node-to-satellite-ive-lost-this-block-sorry/7024):
>
> Just a simple scrub. If a block is lost tell the satellite. This is better for both ends. The satellite wants to know and the storagenode would prefer not to get disqualified. The storagenode pays for this leniency by disk bandwidth and power. #enable scrub constant, weekly, monthly #scrub=weekly The satellite manages this using reputation calculations (and held amount) So you can’t use it to cheat or graceful exit

And the result the same - node have no idea what pieces are lost, the same for the satellite. The only way to figure that out is performing a full audit for the same price as recover. But in case of repair the satellite will download only 29 pieces and generates a missed 51 rather download a whole number of pieces in case of a full audit. Just not worth it.  
And repaired pieces will never come back to the same node, which managed to lost them. It is already proved its unreliability.

---

<div class="post-metadata">

**Author:** ![andrew2.hart](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/andrew2.hart/32/6415_2.png) [@andrew2.hart](https://forum.storj.io/u/andrew2.hart)\
**Post date:** [December 31, 2020, 12:52pm UTC](https://forum.storj.io/t/repair-node-feature-download-missing-files/10936/7 "2020-12-31T12:52:52Z")

</div>

When you check the code and see that you can’t find code for blob checksums or even expected size, you come to the same conclusion eventually.  
The audit IS the scrub/repair

---

<div class="post-metadata">

**Author:** ![joesmoe](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/joesmoe/32/63_2.png) [@joesmoe](https://forum.storj.io/u/joesmoe)\
**Post date:** [January 1, 2021, 6:48pm UTC](https://forum.storj.io/t/repair-node-feature-download-missing-files/10936/8 "2021-01-01T18:48:31Z")

</div>

I have 2 bad files according to ZFS that were not repairable on around a 150TB array.

Hoping they are never audited 🙂

Happy new years everyone!

---

<div class="post-metadata">

**Author:** ![kevink](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/kevink/32/6077_2.png) [@kevink](https://forum.storj.io/u/kevink)\
**Post date:** [January 1, 2021, 7:30pm UTC](https://forum.storj.io/t/repair-node-feature-download-missing-files/10936/9 "2021-01-01T19:30:38Z")

</div>

I had a few bad files too and removed them. Recently one of those got audited 😃 Audit rate dropped a bit but a few hours later it was back at 100%.

---

<div class="post-metadata">

**Author:** ![Pac](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/pac/32/6053_2.png) [@Pac](https://forum.storj.io/u/Pac)\
**Post date:** [January 2, 2021, 12:34pm UTC](https://forum.storj.io/t/repair-node-feature-download-missing-files/10936/10 "2021-01-02T12:34:37Z")

</div>

> [@joesmoe](#):
>
> Hoping they are never audited 🙂

I agree with @kevink:  
Don’t worry about that, 2 files are nothing. The Tardigrade network has been designed to support a few losses.  
I lost 2000 files once, but because the node has millions of files, its audit score drops a little from time to time, but it doesn’t get disqualified as chances to audit 10 missing files in a row are almost non-existent.

---

<div class="post-metadata">

**Author:** ![Pac](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/pac/32/6053_2.png) [@Pac](https://forum.storj.io/u/Pac)\
**Post date:** [January 2, 2021, 5:51pm UTC](https://forum.storj.io/t/repair-node-feature-download-missing-files/10936/11 "2021-01-02T17:51:32Z")

</div>

> [@kevink](#):
>
> Audit rate dropped a bit but a few hours later it was back at 100%.

Didn’t realize at first read, but it doesn’t behave this way on my side (it’s _way_ slower): whenever an audit fails, score drops from 100% to 95% approximately.  
Then it takes days to get back to 100%, and the closer it gets to 100%, the slower it gets…

And finally, 15 days later or so, it’s back to 100% (thx to roundind - in fact it never reaches a perfect 100% again from an API point of view).

These scores for one of my nodes are still being plotted online if anyone’s interested:

> **[Audits N3 (scores) - ThingSpeak IoT](https://thingspeak.com/channels/1120915)**
>
> Audits N3 (scores) on ThingSpeak. ThingSpeak is the open IoT platform with MATLAB analytics.

But I guess this highly depends on the amount of data the node stores, so YMMV… This particular node stores 0.6TB only at the moment.

---

<div class="post-metadata">

**Author:** ![kevink](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/kevink/32/6077_2.png) [@kevink](https://forum.storj.io/u/kevink)\
**Post date:** [January 2, 2021, 7:00pm UTC](https://forum.storj.io/t/repair-node-feature-download-missing-files/10936/12 "2021-01-02T19:00:21Z")

</div>

> [@Pac](#):
>
> Then it takes days to get back to 100%, and the closer it gets to 100%, the slower it gets…
> 
> And finally, 15 days later or so, it’s back to 100%

> [@Pac](#):
>
> This particular node stores 0.6TB only at the moment.

That’s why it took so long in your case. My node has 2TB. After 22h back to 100%. Depends on the amount of audits you get.

 ![grafik](https://storj-s3.bcdn.literatehosting.net/original/2X/8/875b4f93cb3524be4efb47c23268c54f5df366c4.png)
