Yesterday I had a filesystem crash on my node. I quickly deleted everything and deployed a new node with a new identity, used same external ip:port. New node says offline and QUIC misconfigured, although it is perfectly visible from the outside.
Now I have to wait until all satellites expire my old node to accept the new one, or what? Is there a way to speed up this?
The end of the log is:
2024-06-05T14:50:48+03:00 | ERROR | nodestats:cache | Get disk space usage query failed | {error: nodestats: EOF; nodestats: EOF; nodestats: EOF; nodestats: EOF, errorVerbose: group:\n— nodestats: EOF\n\tstorj.io/storj/storagenode/nodestats.(*Service).GetDailyStorageUsage:123\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheSpaceUsage.func1:216\n\tstorj.io/storj/storagenode/nodestats.(*Cache).satelliteLoop:306\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheSpaceUsage:215\n\tstorj.io/storj/storagenode/nodestats.(*Cache).Run.func3:138\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78\n— nodestats: EOF\n\tstorj.io/storj/storagenode/nodestats.(*Service).GetDailyStorageUsage:123\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheSpaceUsage.func1:216\n\tstorj.io/storj/storagenode/nodestats.(*Cache).satelliteLoop:306\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheSpaceUsage:215\n\tstorj.io/storj/storagenode/nodestats.(*Cache).Run.func3:138\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78\n— nodestats: EOF\n\tstorj.io/storj/storagenode/nodestats.(*Service).GetDailyStorageUsage:123\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheSpaceUsage.func1:216\n\tstorj.io/storj/storagenode/nodestats.(*Cache).satelliteLoop:306\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheSpaceUsage:215\n\tstorj.io/storj/storagenode/nodestats.(*Cache).Run.func3:138\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78\n— nodestats: EOF\n\tstorj.io/storj/storagenode/nodestats.(*Service).GetDailyStorageUsage:123\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheSpaceUsage.func1:216\n\tstorj.io/storj/storagenode/nodestats.(*Cache).satelliteLoop:306\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheSpaceUsage:215\n\tstorj.io/storj/storagenode/nodestats.(*Cache).Run.func3:138\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78} |
---|---|---|---|---|
2024-06-05T14:50:48+03:00 | ERROR | nodestats:cache | payouts err | {satellite: 1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE} |
2024-06-05T14:50:49+03:00 | ERROR | nodestats:cache | payouts err | {satellite: 121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6} |
2024-06-05T14:50:49+03:00 | ERROR | nodestats:cache | payouts err | {satellite: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S} |
2024-06-05T14:50:49+03:00 | ERROR | nodestats:cache | payouts err | {satellite: 12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs} |
2024-06-05T14:50:49+03:00 | ERROR | nodestats:cache | Get held amount query failed | {error: payouts service: node not found: 12Pop9nxiU8RrkkasFANNtSS7JZZmKYhRxXvTXbW2jBZc3aKT5V; payouts service: node not found: 12Pop9nxiU8RrkkasFANNtSS7JZZmKYhRxXvTXbW2jBZc3aKT5V; payouts service: node not found: 12Pop9nxiU8RrkkasFANNtSS7JZZmKYhRxXvTXbW2jBZc3aKT5V; payouts service: node not found: 12Pop9nxiU8RrkkasFANNtSS7JZZmKYhRxXvTXbW2jBZc3aKT5V, errorVerbose: group:\n— payouts service: node not found: 12Pop9nxiU8RrkkasFANNtSS7JZZmKYhRxXvTXbW2jBZc3aKT5V\n\tstorj.io/storj/storagenode/payouts.(*Endpoint).GetPaystub:73\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheHeldAmount.func1:249\n\tstorj.io/storj/storagenode/nodestats.(*Cache).satelliteLoop:306\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheHeldAmount:241\n\tstorj.io/storj/storagenode/nodestats.(*Cache).Run.func3:143\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78\n— payouts service: node not found: 12Pop9nxiU8RrkkasFANNtSS7JZZmKYhRxXvTXbW2jBZc3aKT5V\n\tstorj.io/storj/storagenode/payouts.(*Endpoint).GetPaystub:73\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheHeldAmount.func1:249\n\tstorj.io/storj/storagenode/nodestats.(*Cache).satelliteLoop:306\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheHeldAmount:241\n\tstorj.io/storj/storagenode/nodestats.(*Cache).Run.func3:143\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78\n— payouts service: node not found: 12Pop9nxiU8RrkkasFANNtSS7JZZmKYhRxXvTXbW2jBZc3aKT5V\n\tstorj.io/storj/storagenode/payouts.(*Endpoint).GetPaystub:73\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheHeldAmount.func1:249\n\tstorj.io/storj/storagenode/nodestats.(*Cache).satelliteLoop:306\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheHeldAmount:241\n\tstorj.io/storj/storagenode/nodestats.(*Cache).Run.func3:143\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78\n— payouts service: node not found: 12Pop9nxiU8RrkkasFANNtSS7JZZmKYhRxXvTXbW2jBZc3aKT5V\n\tstorj.io/storj/storagenode/payouts.(*Endpoint).GetPaystub:73\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheHeldAmount.func1:249\n\tstorj.io/storj/storagenode/nodestats.(*Cache).satelliteLoop:306\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheHeldAmount:241\n\tstorj.io/storj/storagenode/nodestats.(*Cache).Run.func3:143\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78} |
2024-06-05T14:52:04+03:00 | ERROR | contact:service | ping satellite failed | {Satellite ID: 12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs, attempts: 9, error: ping satellite: check-in ratelimit: node rate limited by id, errorVerbose: ping satellite: check-in ratelimit: node rate limited by id\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:203\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78} |
2024-06-05T14:52:07+03:00 | ERROR | contact:service | ping satellite failed | {Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, attempts: 9, error: ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: tls peer certificate verification: not signed by any CA in the whitelist: CA cert, errorVerbose: ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: tls peer certificate verification: not signed by any CA in the whitelist: CA cert\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78} |
2024-06-05T14:52:10+03:00 | ERROR | contact:service | ping satellite failed | {Satellite ID: 121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6, attempts: 9, error: ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: tls peer certificate verification: not signed by any CA in the whitelist: CA cert, errorVerbose: ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: tls peer certificate verification: not signed by any CA in the whitelist: CA cert\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78} |
2024-06-05T14:52:12+03:00 | ERROR | contact:service | ping satellite failed | {Satellite ID: 1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE, attempts: 9, error: ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: tls peer certificate verification: not signed by any CA in the whitelist: CA cert, errorVerbose: ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: tls peer certificate verification: not signed by any CA in the whitelist: CA cert\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78} |