Newish User: WTF happened and why? To ZERO on 1 satellite within a day

My node is online since about 3 weeks. All seemed well.

I was at 100 % besides us2.t… at 99.98

now within a day and no forewarning the system being up and online, I have 0 at europe-north-1.tardigrade.io:7777

My system is up, the IP hasn’t changed. Port 28967 is open on 86.etc.

The logs indicate that yesterday the downtime of europe-west-1.tardigrade.io:7777 was detected.
"ping satellite error: rpc: dial tcp 35.205.38.124:7777:

Then I have to EOF errors that’s it
**2021-03-14T16:10:10.911Z ERROR piecestore upload failed {“Piece ID”: “Z5NB6CGPDRW2MHNS3PMXXAQBBE4RS6NWKMTN6LCDJNN7ONMVWU6Q”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”, “error”: “unexpected EOF”, “errorVerbose”: “unexpected EOF\n\tstorj.io/common/rpc/rpcstatus.Error:82\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:325\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:996\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:29\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:58\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:111\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:62\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:99\n\tstorj.io/drpc/drpcctx.(*Tracker).track:51”, “Size”: 532480}
2021-03-15T13:21:24.217Z ERROR piecestore upload failed {“Piece ID”: “MECUIARRQEUYWWKDCTBXETHHGXWI4RAWH5B57QYXOETLL2JQX2RQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”, “error”: “unexpected EOF”, “errorVerbose”: "unexpected EOF\n\tstorj.io/common/rpc/rpcstatus.Error:82\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:325\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:996\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:29\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:58\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:111\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:62\n\tstorj.io/drpc/drpcserver.(Server).Serve.func2:99\n\tstorj.io/drpc/drpcctx.(Tracker).track:51", “Size”: 532480}

In the moment all seems ok
2021-03-15T23:41:40.760Z INFO piecedeleter deleted {“Satellite ID”: “12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo”, “Piece ID”: “E3AURCVO5NGHH4FFB3TAAYWPRXSP3EGSQAAU4X5Q3F72YFXT2BUA”}
2021-03-15T23:41:54.467Z INFO piecestore upload started {“Piece ID”: “NI572JBHE4ADDKPPM3J2AEZUES4WQZKIDLLTCOKZ5DSRRN3OONVA”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “Action”: “PUT”, “Available Space”: 1647097154176}
2021-03-15T23:41:54.545Z INFO piecestore uploaded {“Piece ID”: “NI572JBHE4ADDKPPM3J2AEZUES4WQZKIDLLTCOKZ5DSRRN3OONVA”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “Action”: “PUT”, “Size”: 512}
2021-03-15T23:41:55.933Z INFO piecestore upload started {“Piece ID”: “UZYYN7GCPRJRHK4KPG5OB4IKWXPWBSMH53JKTXWAII4YQS7OJQ7A”, “Satellite ID”: “12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo”, “Action”: “PUT”, “Available Space”: 1647097153152}
2021-03-15T23:42:06.836Z INFO piecestore upload started {“Piece ID”: “PODTYEAWHZGZZIJMFCIPDLNIKQPJVFVQ3ADPLXCQRZNLHBD4JIFQ”, “Satellite ID”: “12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo”, “Action”: “PUT”, “Available Space”: 1647097153152}
2021-03-15T23:42:18.856Z INFO piecestore uploaded {“Piece ID”: “UZYYN7GCPRJRHK4KPG5OB4IKWXPWBSMH53JKTXWAII4YQS7OJQ7A”, “Satellite ID”: “12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo”, “Action”: “PUT”, “Size”: 2319360}
2021-03-15T23:42:20.279Z INFO piecestore uploaded {“Piece ID”: “PODTYEAWHZGZZIJMFCIPDLNIKQPJVFVQ3ADPLXCQRZNLHBD4JIFQ”, “Satellite ID”: “12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo”, “Action”: “PUT”, “Size”: 1786112}

You were likely just unlucky enough to be offline during the only audit you got from that satellite. The first 30 days your node won’t be disqualified. If after that you are still below 60% score your node will be suspended on that satellite, but you will still get a chance to recover. Just keep your nodes always online from now on and it will be fine.

2 Likes

The issue would have been that the noip update daemon was a bit more challenging to set up than described by NO-IP so an IP address change was not broadcast.

Create noip2 service for systemd

I hope I fixed the problem.

Nevertheless that problem was about 4 days ago and as an inexperienced SNO one can only find out by experience that there seems to be a time delay.

I would like to suggest you to configure your router to update your DDNS hostname, it’s usually in the DDNS section. If you would configure your router to update your DDNS, then you should remove the DUC from your device to avoid conflicts.

2 Likes

Thank you for your advise, the values seem to go up again,

Thank you Alexey. I have done that.

1 Like