My 16 - 17 month old node failed an audit. i don’t believe i lost a file, however it is an old node and has been migrated a fair number of times … maybe 7 … so it’s not totally impossible that i could have lost a file… and have like most other long term SNO’s ofc had various issues over my time ru…

This is our hypothesis about what’s happened. US2 from the beginning was using objects and segments table (metabase). During one of deployments, we had an issue where migration couldn’t be executed because a number of entries was too big. Because it was US2 we decided to do some hot fixes directly …

Same for my node. I was also able to retrace the audit failure to an expired piece in my logs. I am at 99.5% audit score right now. Let’s hope this was a one time occurrence.

if i was to hazard a guess… it almost looks like a test i mean why just one… whatever happened here might be used maliciously… if one could DQ nodes for data that is long deleted. also the error seems to still be permeating through the network… got another node that has just failed an audit since …

Exactly same happened to me. I figured its the sattelite. Because i just installed a brand new HDD and transferred with 3 robocopies with /MIR the contents.

same here yesterday for us1 and ap1 But is growing again.

whatever the causes, this is bad… very bad… seems to affect nodes around the 7-8 month mark the worst… atleast with never having a failed audit before then, my nodes are pretty well positioned to survive. this might get worse before it gets better [image]

I am now seriously wondering what happens if Nodes is disqualified because of this error? How does Storj intend to compensate the node operator? We SNOs are obviously not responsible for this… My audit grew again overnight, but is now falling further. This happens on several nodes, so I can rule …

This a storj network software issue, most likely related to the latest update… so if anyone is on the old version lets hear if you are seeing this… also tried apt upgrade my container and a cold reboot of the container… but no joy. @LinuxNet i will most likely shutdown my nodes if it comes to tha…

Let’s also try to keep misleading info to a minimum. I believe you said elsewhere that the audit score drops on other satellites had to do with a migration you did. As of now I don’t have any reason to think the delete issue is wider spread than ap1. Please look up logs for other satellites if you t…

yeah thats right, i haven’t gotten around to correcting it… remembered after i had written it here. deleted it for simplicity sake.

Started approx 7/22 15:40 [Screenshot 2021-07-23 8.13.36 AM]

Storj Community Forum (official)

Audit weirdness (us2 satellite). (Team aware. No additional information is needed)

Node Operators troubleshooting