Disqualified on Stefan satellite during Graceful Exit

[Alexey]

Sorry, I can’t download from there, it’s blocked in my country

[BrightSilence]

I’ll just point to this source… I think you’ll agree that he would probably know.

Only facts that EU-North satellite only for space reservation

Whats the problem with 3 test satellites? Mine specifically is not shutdown in the sense of “shutdown”, rather than repurposed soon. In terms of why have multiple satellites to test? Because there are tests that have to be executed side by side to notice difference more granular and rule out other environmental issues. In terms of the hold escrow i can assure you, that all nodes will get their amount paid when the satellites is fully shutdown. That noted, my satellite currently still holds 25…

He posted some more responses on that topic hinting you may be sorry if you exited the satellite.

[kevink]

For that reason I created a new node. Should stefan-benten not reset the GEed nodes, then I will use that node just for his satellite.
Sounded to me like the better solution than risking multiple hundred USD in held back (even though they will be paid when stefan-benten resets/shuts down but we keep hearing that since at least 6 months so I stopped relying on that information…)

[Krey]

@Vadim

it is strange, I mage GE from stefab-benten in june from 10 nodes in row. all was OK

Nothing strange. More exited nodes, less reliable nodes that ready to receive data. Node list from satellite is full of rubish now. I failed second GE and ready to catch a few more

[kevink]

yeah that sounds like a problem lately… My GE has been 4 months ago. But now we should wait for a fix with the next release.

[vovannovig]

It’s good that everyone understands that the problem is not mine.
In order for me to re-run the output, you must unlock my node.
Will you cancel the disqualification?

[ethan]

We are actively working on a fix for this issue. Please create a support ticket if you have not already done so, so we can track your issue. Once the fix is deployed we will remove the disqualification for nodes that were incorrectly disqualified. In the meantime, please refrain from initiating any graceful exits.

[lex-1]

Hopefully google does’nt restrict countries, try this link https://drive.google.com/file/d/1QEHDDYDEywltCKRJFwQDE5j91FQk11eS/view?usp=sharing

[anon27637763]

@lex-1

Hopefully google does’nt restrict countries

That’s only half the problem…

Post it on IPFS, and then it can’t be restricted…

https://hardbin.com/ipfs/QmWD2J7oRBQaHSa3d4poZAcXcrUxw9LUQ78Ft9n6Gv5ksi/

• Select “New”
• The IPFS address of the document can be retrieved and viewed on any public IPFS gateway:

Public Gateway Checker | IPFS

[Alexey]

Yes, thank you! I got the file.

@anon27637763

Post it on IPFS, and then it can’t be restricted…

But can be lost. I saw so many corrupted links…
@anon27637763 For the same you can use the simple https://alpha.transfer.sh , which is backed by Tardigrade.

[vovannovig]

support ticket Id #6040

[vovannovig]

I have all nodes updated to version 1.9.5
I have a lot of node that work with all satellites and have more than 40 Terabytes of free space.

Please unlock my node, I want to redo the graceful exit

[Alexey]

As I was pointed out, the DQ error during GE is not resolved in 1.9.5

Moving the performance tests to a new satellite

Nope. There is no fix in v1.9.5. In fact I was able to reproduce one way to get a false GE result with v1.9.5

So, I’ll update this thread when it is actually would be fixed

[Alexey]

The update on the problem so far:

@littleskunk

Graceful exit disqualification
Most of the storage nodes can finish graceful exit just fine but there are a few edge cases and some storage nodes are getting disqualified for bugs. Here are the bugs that we currently know (order by likelyhood):

1. The storage node has problems with corrupted pieces. The storage node should identify the corruption, report it back to the satellite and continue. As long as the failure rate is low graceful exit should still be succesful. For some reason the storage node identifies the corrupted piece but something is messing up the entire batch. The storage node doesn’t continue as expected. We are working on a fix.
2. Graceful exit is transferring the pieces in a specific order. It starts with pieces that are close to the repair threshold. These are most likely older pieces and they have a higher likelyhood getting corrupted over time. This means a storage node with a overall failure rate of 10% will get most of these failures at the beginning of graceful exit. The satellite is judging after each batch. The storage node might get disqualifed early and has no chance to show the low failure rate at the end of graceful exit. We are working on a fix.
3. After each successful batch the storage node reports the results back to the satellite. We have a connection timeout in place to prevent storage nodes from getting stuck but no retry. This means the results are getting lost and a retry will be triggered. Fix is incoming.

Conclusion:
Lets say there is a 50% chance that you might get disqualified when you execute graceful exit. Would you leave the network anyway or would you stay and wait for a fix? If you would leave anyway you can risk it. The overall success rate is high and most likely it will work. If you see any kind of audit errors in your logs (corrupted or missing pieces) I would recommend to wait for the fix. My expectation is that the combination of issue 1 and 2 is what is causing problems at the moment.

[vovannovig]

I’m sure my nodes are okay.
I have 100% audits, new drives.
All nodes have been updated.
storagenode version 1.10.1 (latest)

Will you unblock me so that I can gracefully exit?

[Alexey]

In such case your node would not be DQ during GE… So, seems it has some corrupted pieces and this is enough to do not finish it…

[vovannovig]

so unblock me!

I tell you about this all the time and tell you that I have new drives, are in the servers, I am confident in the integrity of the data. I attached logs where everything indicates that everything is fine with me.

Please again - unlock so I can make an elegant exit !!!

[vovannovig]

When will you unlock me so I can gracefully exit?

[Alexey]

I have no answer from team yet.