My node went offline last night for a few hours and in scouring the logs I noticed this:
{“log”:“2024-02-28T12:09:47Z\u0009ERROR\u0009piecestore\u0009download failed\u0009{"process": "storagenode", "Piece ID": "3DVORIBMRUL2VPQOLXWRDPJJHXBRT2KZV7U5HLNF7DAUGJW52E
YQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Remote Address": "79.127.223.130:49472", "error": "order created too
long ago: OrderCreation 2024-02-28 10:58:54.465898539 +0000 UTC \u003c SystemClock 2024-02-28 12:09:47.613340289 +0000 UTC m=+850842.709315465", "errorVerbose": "order created
too long ago: OrderCreation 2024-02-28 10:58:54.465898539 +0000 UTC \u003c SystemClock 2024-02-28 12:09:47.613340289 +0000 UTC m=+850842.709315465\n\tstorj.io/common/rpc/rpcsta
tus.Errorf:90\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).verifyOrderLimit:45\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:616\n\tstorj.io/common/p
b.DRPCPiecestoreDescription.Method.func2:251\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experi
ment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serv
e.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}\n”,“stream”:“stdout”,“time”:“2024-02-28T12:09:47.613663088Z”}
Everything is working fine now. Sharing in case this helps.
Also noticed at the time a rapid increase in the number of live requests. Normally I can see up to about 10, but I was seeing over 40 at the time.