Rpc client error when closing sender (US2)

Node Operators troubleshooting
, , ,
1

Noticing these errors every hrs? do I need to worry about it?

2021-09-14T22:29:15.184Z ERROR orders.12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo rpc client error when closing sender {“error”: “order: CloseAndRecv settlement agreements returned an error: context canceled”, “errorVerbose”: “order: CloseAndRecv settlement agreements returned an error: context canceled\n\tstorj.io/storj/storagenode/orders.(*Service).settleWindow:275\n\tstorj.io/storj/storagenode/orders.(*Service).SendOrders.func1:205\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-09-14T22:29:15.184Z INFO orders.12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo finished
2021-09-14T22:29:15.184Z ERROR orders.12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo failed to settle orders for satellite {“satellite ID”: “12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo”, “error”: “order: CloseAndRecv settlement agreements returned an error: context canceled”, “errorVerbose”: “order: CloseAndRecv settlement agreements returned an error: context canceled\n\tstorj.io/storj/storagenode/orders.(*Service).settleWindow:275\n\tstorj.io/storj/storagenode/orders.(*Service).SendOrders.func1:205\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}

2

I can confirm, my nodes see these errors as well

2021-09-15T05:02:20.635Z        ERROR   orders.12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo       rpc client error when closing sender    {"error": "order: CloseAndRecv settlement agreements returned an error: context deadline exceeded", "errorVerbose": "order: CloseAndRecv settlement agreements returned an error: context deadline exceeded\n\tstorj.io/storj/storagenode/orders.(*Service).settleWindow:275\n\tstorj.io/storj/storagenode/orders.(*Service).SendOrders.func1:205\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57"}
2021-09-15T05:02:20.635Z        ERROR   orders.12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo       failed to settl  orders for satellite   {"satellite ID": "12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo", "error": "order: CloseAndRecv settlement agreements returned an error: context deadline exceeded", "errorVerbose": "order: CloseAndRecv settlement agreements returned an error: context deadline exceeded\n\tstorj.io/storj/storagenode/orders.(*Service).settleWindow:275\n\tstorj.io/storj/storagenode/orders.(*Service).SendOrders.func1:205\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57"}
3

I see them too but they seem only to happen on the US2 satellite.

4

Created an issue: order: CloseAndRecv settlement agreements returned an error: context deadline exceeded · Issue #4190 · storj/storj · GitHub

5

They haven’t happened recently on my node, last one was end of June. But I have them for multiple satellites. I don’t think it’s specific to one. I’ve had them on ap1, saltlake and europe-north-1.

1 Like
6

I currently see them in the logs of one node only and they are exclusively from the US2 satellite.

7

A post was merged into an existing topic: ERROR collector unable to delete piece

8

The problem is fixed order: CloseAndRecv settlement agreements returned an error: context deadline exceeded · Issue #4190 · storj/storj · GitHub

1 Like