Strange traffic today

[Adavan]

Hello.
Today I spot some strange behavior:

It seems, that my node was cut off (from ~ 3:00 until ~ 15:00). Node as is was working (metrics for “StorjNode volume usage” and “StorjNode Trash usage”) I collect directly from node API endpoint.
As you can see, node slowly deleted some pieces (sent them to the trash), but no traffic come (metrics for “Volume disk space” I collecting from FS).

Traffic start coming again without any my actions.

From node logs I see many errors, but these errors still occurring. I mean, they are not specify to the strange time window:

2022-11-05T02:01:41.509238796Z 2022-11-05T02:01:41.508Z ERROR piecestore download failed {“Process”: “storagenode”, “Piece ID”: “NMHJTXAMWVJEJGHADJWZMUS2N2TDJGAFA3F3FPDLKRBD2NTQKQDA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET”, “error”: “write tcp 172.17.0.3:28967->184.104.224.98:25922: use of closed network connection”, “errorVerbose”: “write tcp 172.17.0.3:28967->184.104.224.98:25922: use of closed network connection\n\tstorj.io/drpc/drpcstream.(*Stream).rawWriteLocked:326\n\tstorj.io/drpc/drpcstream.(*Stream).MsgSend:404\n\tstorj.io/common/pb.(*drpcPiecestore_DownloadStream).Send:317\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download.func5.1:628\n\tstorj.io/common/rpc/rpctimeout.Run.func1:22”}

2022-11-05T02:11:48.801523178Z 2022-11-05T02:11:48.801Z ERROR piecestore upload failed {“Process”: “storagenode”, “Piece ID”: “KQHHWTIJWJSN6J44ETST2NVPLV7CZ4OSMIPB7W4HMZOSJQMNIIPQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”, “error”: “unexpected EOF”, “errorVerbose”: “unexpected EOF\n\tstorj.io/common/rpc/rpcstatus.Error:82\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:349\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:220\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:122\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:112\n\tstorj.io/drpc/drpcctx.(*Tracker).track:52”, “Size”: 311296}

Is this error alright? Was this interruption alright also?

Thank you for feedback!

[Alexey]

These errors are the consequence of canceled download/upload from/to your node. Some nodes were quickly than yours, nothing unusual, as the deletions too - the customers may decide to remove their data anytime.

[Adavan]

Today morning I spot same behavior too and I attempted to just stop/start storj container.

It seems, that problem was “somewhere” on my side and after restart traffic come again.

Strange thing is, that no error message somewhere, even in system logs . This problem may occurred anytime and I not have any detection mechanism to catch it and be notified .

OK, please consider my problem as solved and hope, I am alone with this problem .

[shellbreaker]

nothing unusual ?

[Alexey]

Hello @shellbreaker,
Welcome to the forum!

The space and bandwidth are used by real people, not machines. Any customers’ behavior is normal. Traffic is flowing directly between your node and the customers of the satellites. Satellites are just an address books, payments processors, audits and repair systems.