# Raid 5 failed. 3TB node dead. Recovered partially and going through GE thanks to forum **URL:** \ **Category:** Node Operators\ **Tags:** raid\ **Created:** [May 18, 2020, 6:02pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914 "2020-05-18T18:02:17Z")\ **Posts on this page:** 20\ **Page:** 2
**Author:** ![fikros](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/fikros/32/1137_2.png) [@fikros](https://forum.storj.io/u/fikros)\ **Post date:** [May 18, 2020, 7:26pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/21 "2020-05-18T19:26:48Z")
I was making close to 30$ / month (surges included) ---
**Author:** ![SGC](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/sgc/32/1132_2.png) [@SGC](https://forum.storj.io/u/SGC)\ **Post date:** [May 18, 2020, 7:28pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/22 "2020-05-18T19:28:01Z")
yeah might be right… i just remember doing to math when looking at the … very inaccurate storj earning calculator. still think GE is a long shot for most nodes performing poorly, ofc some of the restrictions might not be fully implemented yet. if memory serve you are allow 1hour of dt during a month when on GE… and much easier to get DQ and downloads aren’t paid… so all in all… doesn’t sound that appealing imo ---
**Author:** ![kevink](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/kevink/32/6077_2.png) [@kevink](https://forum.storj.io/u/kevink)\ **Post date:** [May 18, 2020, 7:28pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/23 "2020-05-18T19:28:22Z")
That sounds correct. It was mainly the early months on stefan-benten and the january that built up that much held amount. ---
**Author:** ![kevink](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/kevink/32/6077_2.png) [@kevink](https://forum.storj.io/u/kevink)\ **Post date:** [May 18, 2020, 7:30pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/24 "2020-05-18T19:30:39Z")
It’s the only way to get the money back, so it’s worth a shot. If he lost too many pieces, GE won’t work but neither would keeping it running because he might get DQed within 1 week or within a few month. But it’s unlikely that his node would last about 10 month if he lost too many pieces for GE to succeed. I’d rather know now so I can start a new node, rather than getting DQed in a month and losing my held amount anyway. I can’t remember having seen any limitation on downtime during GE, especially because downtime isn’t really tracked at the moment. ---
**Author:** ![fikros](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/fikros/32/1137_2.png) [@fikros](https://forum.storj.io/u/fikros)\ **Post date:** [May 18, 2020, 7:32pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/25 "2020-05-18T19:32:32Z")
Yeah, i got about 3k storj with this node, during this time. Can’t complain, it paid for its datacenter hosting. I am trying GE just to push data back into the network, and if it works, then it works. Not trying to game the system. Most certainly I’m not going to run a malfunctioning node just to cover my GE. ---
**Author:** ![SGC](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/sgc/32/1132_2.png) [@SGC](https://forum.storj.io/u/SGC)\ **Post date:** [May 18, 2020, 7:33pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/26 "2020-05-18T19:33:33Z")
yeah but at 30$ a month two months is 60$ vs on GE he might get nothing… and most likely takes the same amount of time… and one will have to remake the node which means a month of vetting… well i just think in its present form GE is a bit of a joke, atleast if all the feature are implemented… i remember getting the chills from thinking of trying go pass a GE when i read through the requirements… and if the node is a year isn’t it at 15 months that one gets 50% of the held amount paid out anyways… well lots of math in relation to if its worthwhile or not… but since i don’t expect to use it in its current form because i think GE requirements are ridiculous, then won’t really go check up on it for a good long time… hopefully it will be more reasonable at that point in time, when i do feel like using it. ---
**Author:** ![kevink](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/kevink/32/6077_2.png) [@kevink](https://forum.storj.io/u/kevink)\ **Post date:** [May 18, 2020, 7:39pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/27 "2020-05-18T19:39:29Z")
I’m not sure where the joke here is… if GE works, he gets 200$, if it doesn’t work, he needs a new node anyway. Sure, he might get 30-60$ before getting DQed if he is extremely lucky… But then he would have to set up a new node anyway. And if GE takes a month, he’d get 30$ for that month too. So sure, it’s a gamble between 200$ and 30$ but the sooner you know, the sooner you can spin up a new node. (Well you can spin up a new node in any case if you have a spare drive) In the long run I wouldn’t risk running a node that possibly lost or corrupted lots of data. I’d rather get a new and reliable node up as quickly as possible. I did 2 GEs on stefan-benten, both without a problem. but of course I did not lose files… ---
**Author:** ![SGC](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/sgc/32/1132_2.png) [@SGC](https://forum.storj.io/u/SGC)\ **Post date:** [May 18, 2020, 8:48pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/28 "2020-05-18T20:48:27Z")
well > [@Graceful Exit Guide](https://forum.storj.io/t/graceful-exit-guide/3618): > > Warning: Read this carefully before you start Please read the following information carefully and ask any questions your might have before executing graceful exit. Once graceful exit is started there is no way to stop or cancel it. If graceful exit is failing even at 99% you will not get any hold back amount. Think about the consequences twice before you call it. Requirements: Storage node has joined the network more than 15 month ago (requirement temporary reduced to 6 month). Storage node … because of that the GE requirement has become lower than the 15month 50% withheld amount payout amount… so because of that one would only get 100$ for a successful graceful exit, and if downtime tracking was implemented i believe the limitation is 1hour of dt a month + the audit failure restrictions before DQ goes up, and you are not paid for the GE traffic, thus might in some cases take away from the node earning while in GE. so really you should be comparing 100$ + much higher chance of DQ and getting nothing at all… versus surfing the dying node onward to earn reliable profit putting less stress on the hardware and not limited by GE bandwidth usage… but yeah presently it might be fine… but how the final plan looks… well i know i never will use it if GE will look like that, imo the risk vs reward seems to favor crashing and burning… but i guess this is another part of the network that isn’t finished yet… ---
**Author:** ![Sasha](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/sasha/32/69_2.png) [@Sasha](https://forum.storj.io/u/Sasha)\ **Post date:** [May 18, 2020, 9:56pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/29 "2020-05-18T21:56:02Z")
Damn, what are the odds of 2 drives failing so close together… Can you post if these were new or used drives? Also what brand and model? ---
**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\ **Post date:** [May 18, 2020, 9:59pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/30 "2020-05-18T21:59:21Z")
It’s RAID5. It’s expected to fail with consumers disks during rebuild: > [@Hardware configuration and receiving mail with token](https://forum.storj.io/t/6445/4): > > 8 disks is not few disks. You may think you’re running a small risk, but you’re absolutely not. Please read this: [The Latest - Whether RAID 5 is still safe in 2019 - Digistor Australia](https://www.digistor.com.au/the-latest/Whether-RAID-5-is-still-safe-in-2019/) If you don’t want to read the entire article, here is the most important image. With your setup in RAID5, you’re almost guaranteed to fail a rebuild. Have enterprise level HDD’s with lower URE rates? The image does look better, but still not great at all. It seems the P440 supports online … ---
**Author:** ![Storgeez](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/storgeez/32/68_2.png) [@Storgeez](https://forum.storj.io/u/Storgeez)\ **Post date:** [May 18, 2020, 10:47pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/31 "2020-05-18T22:47:58Z")
If they were cheap or Seagate drives, it is expected for them to fail easily. Especially true for drives bought as external HDDs, these are often very bad as manufacturers count on them not being used much and possibly put the worst ones in there. ---
**Author:** ![donald.m.motsinger](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/donald.m.motsinger/32/71_2.png) [@donald.m.motsinger](https://forum.storj.io/u/donald.m.motsinger)\ **Post date:** [May 18, 2020, 10:51pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/32 "2020-05-18T22:51:53Z")
> [@Storgeez](#): > > If they were cheap or Seagate drives, it is expected for them to fail easily. Do you have more than anecdotal evidence for that claim? ---
**Author:** ![Storgeez](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/storgeez/32/68_2.png) [@Storgeez](https://forum.storj.io/u/Storgeez)\ **Post date:** [May 18, 2020, 11:10pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/33 "2020-05-18T23:10:27Z")
4 failed Seagates, no other brand failed (yet). Also check Backblaze stats. ---
**Author:** ![donald.m.motsinger](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/donald.m.motsinger/32/71_2.png) [@donald.m.motsinger](https://forum.storj.io/u/donald.m.motsinger)\ **Post date:** [May 18, 2020, 11:19pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/34 "2020-05-18T23:19:56Z")
> [@Storgeez](#): > > 4 failed Seagates, no other brand failed (yet). so, anecdotal? > [@Storgeez](#): > > Also check Backblaze stats. If I understand it right, they only used HGST, Seagate and Toshiba and no WD in 2019. I wonder why? ---
**Author:** ![Krey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/krey/32/63_2.png) [@Krey](https://forum.storj.io/u/Krey)\ **Post date:** [May 18, 2020, 11:22pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/35 "2020-05-18T23:22:15Z")
I know person from NAS forum who loose 30 of 30 purchased seagate st3000dm001. Personally i loose 5 of 5 purchased disks of this model. ---
**Author:** ![litori](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/litori/32/1132_2.png) [@litori](https://forum.storj.io/u/litori)\ **Post date:** [May 18, 2020, 11:23pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/36 "2020-05-18T23:23:42Z")
Western Digital acquired HGST in 2012. Same company now. ---
**Author:** ![Storgeez](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/storgeez/32/68_2.png) [@Storgeez](https://forum.storj.io/u/Storgeez)\ **Post date:** [May 18, 2020, 11:26pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/37 "2020-05-18T23:26:32Z")
> [@donald.m.motsinger](#): > > so, anecdotal? Note sure what definition you mean: “(of an account) not necessarily true or reliable, because based on personal accounts rather than facts or research.” It was based on personal and nonpersonal experiences. It was based on facts and I did my research, Seagates fail much more often. “based on or consisting of reports or observations of usually unscientific observers” I am a very scientific person. “of, relating to, or consisting of [anecdotes]” That is right, any kind of answer consisting loosely of what I said would be considered an anecdote. > [@donald.m.motsinger](#): > > If I understand it right, they only used HGST, Seagate and Toshiba and no WD in 2019. I wonder why? HGST is under WD. > [@Krey](#): > > I know person from NAS forum who loose 30 of 30 purchased seagate st3000dm001. > Personally i loose 5 of 5 purchased disks of this model. Sadly this anecdote is hilarious. =/ ---
**Author:** ![direktorn](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/direktorn/32/69_2.png) [@direktorn](https://forum.storj.io/u/direktorn)\ **Post date:** [May 18, 2020, 11:48pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/38 "2020-05-18T23:48:26Z")
you know that just loosing a single file or god-forbid the DBs is bad??? ---
**Author:** ![IOwnCalculus](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/iowncalculus/32/66_2.png) [@IOwnCalculus](https://forum.storj.io/u/IOwnCalculus)\ **Post date:** [May 18, 2020, 11:59pm UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/39 "2020-05-18T23:59:44Z")
I realize this is way late for the data at hand, but I’ve actually had ZFS save my array - twice! - from failures like this. In both cases I was lucky enough that when I had two drives fail, at least one of them was still returning mostly valid data other than a string of bad blocks. ZFS recovered what it could, and flagged the specific files it could not successfully rebuild. ---
**Author:** ![BrightSilence](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/brightsilence/32/6048_2.png) [@BrightSilence](https://forum.storj.io/u/BrightSilence)\ **Post date:** [May 19, 2020, 4:21am UTC](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914/40 "2020-05-19T04:21:34Z")
Seagate had one super bad model that lead to class action lawsuits. I don’t think that’s a reason to ignore the entire brand, but I guess people have trouble letting that one go. Hey, it’s still their f up, so it’s not entirely unfair either. If you exclude this model there is no significant difference in reliability between the major brands. Some models do a little better, some a little worse. > [@direktorn](#): > > you know that just loosing a single file or god-forbid the DBs is bad??? Losing a db you can easily recover from with the worst damage being some stats on the dashboard that are wrong. They contain non-essential data. The only way your node could fail audits is when they are corrupt and can’t be accessed. But you don’t get disqualified for this, just suspended. So unless you ignore issues for at least a week, database loss is recoverable. Same for a single file. With the rate of audits, chances are you will never fail a single audit if you only lose one file. Though losing a significant chunk is obviously bad. [Previous page](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914.md?page=1) [Next page](https://forum.storj.io/t/raid-5-failed-3tb-node-dead-recovered-partially-and-going-through-ge-thanks-to-forum/6914.md?page=3)