The node is online, but there doesn't seem to be any Ingress

Dr.Ko · May 8, 2024, 11:51am

The node is online, but there doesn’t seem to be any reception.

Get-Content “node.log”-Wait -Tail 20

2024-05-08T20:43:49+09:00       ERROR   piecestore      download failed {"Piece ID": "GAVVUFKJPCKTOR66TIND7I5LR6I5CTZL7VRXL7HHBG3UP6M2PGKQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET_REPAIR", "Offset": 0, "Size": 2174464, "Remote Address": "5.161.92.92:57746", "error": "file does not exist", "errorVerbose": "file does not exist\n\tstorj.io/common/rpc/rpcstatus.Wrap:76\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:687\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:302\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:167\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:109\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:157\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2024-05-08T20:43:49+09:00       INFO    piecestore      download started        {"Piece ID": "GCWUQVJCFHWDTUAYR3SQ5H3N7WVSQMN7BS4M4WA7ID7WDKLIKGQA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 135680, "Remote Address": "79.127.201.209:59172"}
2024-05-08T20:43:49+09:00       INFO    piecestore      downloaded      {"Piece ID": "GCWUQVJCFHWDTUAYR3SQ5H3N7WVSQMN7BS4M4WA7ID7WDKLIKGQA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 135680, "Remote Address": "79.127.201.209:59172"}
2024-05-08T20:43:50+09:00       INFO    piecestore      download started        {"Piece ID": "XYP4I6XOHJMVCWNMXMLXBGTFLQOBOX76OOBI7GCEM3DCV66MHNOQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 1811712, "Size": 181504, "Remote Address": "79.127.226.100:47676"}
2024-05-08T20:43:51+09:00       INFO    piecestore      downloaded      {"Piece ID": "XYP4I6XOHJMVCWNMXMLXBGTFLQOBOX76OOBI7GCEM3DCV66MHNOQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 1811712, "Size": 181504, "Remote Address": "79.127.226.100:47676"}
2024-05-08T20:43:56+09:00       INFO    piecestore      download started        {"Piece ID": "XYP4I6XOHJMVCWNMXMLXBGTFLQOBOX76OOBI7GCEM3DCV66MHNOQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 1992960, "Size": 181248, "Remote Address": "79.127.226.100:47676"}
2024-05-08T20:43:56+09:00       INFO    piecestore      download started        {"Piece ID": "3UET4WGTVKCJG2EIUAOL6WFCQJZ3GJ3DEQ4LP5M7MGYG3LSIBDUQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 8704, "Remote Address": "79.127.226.97:40236"}
2024-05-08T20:43:56+09:00       INFO    piecestore      downloaded      {"Piece ID": "XYP4I6XOHJMVCWNMXMLXBGTFLQOBOX76OOBI7GCEM3DCV66MHNOQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 1992960, "Size": 181248, "Remote Address": "79.127.226.100:47676"}
2024-05-08T20:43:57+09:00       INFO    piecestore      downloaded      {"Piece ID": "3UET4WGTVKCJG2EIUAOL6WFCQJZ3GJ3DEQ4LP5M7MGYG3LSIBDUQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 8704, "Remote Address": "79.127.226.97:40236"}
2024-05-08T20:44:00+09:00       INFO    piecestore      download started        {"Piece ID": "XYP4I6XOHJMVCWNMXMLXBGTFLQOBOX76OOBI7GCEM3DCV66MHNOQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 1630464, "Size": 181504, "Remote Address": "79.127.226.100:47676"}
2024-05-08T20:44:01+09:00       INFO    piecestore      downloaded      {"Piece ID": "XYP4I6XOHJMVCWNMXMLXBGTFLQOBOX76OOBI7GCEM3DCV66MHNOQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 1630464, "Size": 181504, "Remote Address": "79.127.226.100:47676"}
2024-05-08T20:44:01+09:00       INFO    piecestore      download started        {"Piece ID": "XFEUG7GMC3P7JZRXC24MGN4EGBC43KODEHDZ4WGHB6GP6SEHMQAA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 6144, "Remote Address": "79.127.201.209:39016"}
2024-05-08T20:44:02+09:00       INFO    piecestore      downloaded      {"Piece ID": "XFEUG7GMC3P7JZRXC24MGN4EGBC43KODEHDZ4WGHB6GP6SEHMQAA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 6144, "Remote Address": "79.127.201.209:39016"}
2024-05-08T20:44:04+09:00       INFO    piecestore      download started        {"Piece ID": "XYP4I6XOHJMVCWNMXMLXBGTFLQOBOX76OOBI7GCEM3DCV66MHNOQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 1992960, "Size": 181248, "Remote Address": "79.127.226.100:47676"}
2024-05-08T20:44:05+09:00       INFO    piecestore      downloaded      {"Piece ID": "XYP4I6XOHJMVCWNMXMLXBGTFLQOBOX76OOBI7GCEM3DCV66MHNOQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 1992960, "Size": 181248, "Remote Address": "79.127.226.100:47676"}

sls “GET_AUDIT” “C:\Program Files\Storj\Storage Node\node.log” | sls “failed”

tdps3S", "Action": "GET_AUDIT", "Offset": 17152, "Size": 0, "Remote Address": "35.245.184.174:35355", "error": "write tcp 192.168.0.2:28967->35.245.184.174:35355: wsasend: An established connection was aborte
d by the software in your host machine.", "errorVerbose": "write tcp 192.168.0.2:28967->35.245.184.174:35355: wsasend: An established connection was aborted by the software in your host machine.\n\tstorj.io/d
rpc/drpcstream.(*Stream).rawFlushLocked:401\n\tstorj.io/drpc/drpcstream.(*Stream).MsgSend:462\n\tstorj.io/common/pb.(*drpcPiecestore_DownloadStream).Send:349\n\tstorj.io/storj/storagenode/piecestore.(*Endpoin
t).sendData.func1:861\n\tstorj.io/common/rpc/rpctimeout.Run.func1:22"}
node.log:71619052:2024-05-06T07:30:10+09:00     ERROR   piecestore      download failed {"Piece ID": "6EQLKV5OS4BDUUE7WHPGQOUNZOVYPL27OAIUV7YY6A7AH5SMADLQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLU
tdps3S", "Action": "GET_AUDIT", "Offset": 316160, "Size": 256, "Remote Address": "35.245.53.42:43087", "error": "file does not exist", "errorVerbose": "file does not exist\n\tstorj.io/common/rpc/rpcstatus.Wra
p:76\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:687\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:302\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpct
racing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:167\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:109\n\tstorj.io/drpc/drp
cserver.(*Server).Serve.func2:157\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
node.log:71660071:2024-05-06T19:22:12+09:00     ERROR   piecestore      download failed {"Piece ID": "JTJIE26655O6JFDXUSZVDLUP6GDAUD5F4G5IR5DCUBXCRKFRGDQA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLU
tdps3S", "Action": "GET_AUDIT", "Offset": 1433600, "Size": 256, "Remote Address": "35.245.53.42:14021", "error": "file does not exist", "errorVerbose": "file does not exist\n\tstorj.io/common/rpc/rpcstatus.Wr
ap:76\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:687\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:302\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpc
tracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:167\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:109\n\tstorj.io/drpc/dr
pcserver.(*Server).Serve.func2:157\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
node.log:71664069:2024-05-06T21:28:14+09:00     ERROR   piecestore      download failed {"Piece ID": "6EEB7OJDAJWKG6EKX3MTUQ64EQJJCC535Z7PYETIEDQEPZRR6MXA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLU
tdps3S", "Action": "GET_AUDIT", "Offset": 2278912, "Size": 256, "Remote Address": "35.245.53.42:65234", "error": "file does not exist", "errorVerbose": "file does not exist\n\tstorj.io/common/rpc/rpcstatus.Wr
ap:76\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:687\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:302\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpc
tracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:167\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:109\n\tstorj.io/drpc/dr
pcserver.(*Server).Serve.func2:157\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
node.log:71667459:2024-05-06T22:59:50+09:00     ERROR   piecestore      download failed {"Piece ID": "EZUR4TDJ2JHZQCLCHKC7QXCX6JRGCSJ47B3HJIIY63X7SBA67U7Q", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLU
tdps3S", "Action": "GET_AUDIT", "Offset": 234752, "Size": 256, "Remote Address": "35.245.53.42:29489", "error": "file does not exist", "errorVerbose": "file does not exist\n\tstorj.io/common/rpc/rpcstatus.Wra
p:76\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:687\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:302\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpct
racing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:167\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:109\n\tstorj.io/drpc/drp
cserver.(*Server).Serve.func2:157\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
node.log:71681993:2024-05-07T04:53:42+09:00     ERROR   piecestore      download failed {"Piece ID": "XQO7OAUORG36ISYXB5F3AQUERVW7EYAGUOM6LSN5IPEZPISMDEAQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLU
tdps3S", "Action": "GET_AUDIT", "Offset": 270080, "Size": 256, "Remote Address": "35.245.53.42:27860", "error": "file does not exist", "errorVerbose": "file does not exist\n\tstorj.io/common/rpc/rpcstatus.Wra
p:76\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:687\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:302\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpct
racing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:167\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:109\n\tstorj.io/drpc/drp
cserver.(*Server).Serve.func2:157\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
node.log:71692084:2024-05-07T08:13:41+09:00     ERROR   piecestore      download failed {"Piece ID": "6EEKYQCSV5EX7EZK6SCAIIBNS5EZNRSJHM746PDJ72VXMI6IU2PQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLU
tdps3S", "Action": "GET_AUDIT", "Offset": 281600, "Size": 256, "Remote Address": "35.245.53.42:58093", "error": "file does not exist", "errorVerbose": "file does not exist\n\tstorj.io/common/rpc/rpcstatus.Wra
p:76\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:687\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:302\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpct
racing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:167\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:109\n\tstorj.io/drpc/drp
cserver.(*Server).Serve.func2:157\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
node.log:71842371:2024-05-08T11:38:56+09:00     ERROR   piecestore      download failed {"Piece ID": "JTMN7XZAJ3MCNZHOPPFDLFZWU5SCL4YXMEHC3HIYT6UR2PWISB3A", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLU
tdps3S", "Action": "GET_AUDIT", "Offset": 1578752, "Size": 256, "Remote Address": "35.245.53.42:51735", "error": "file does not exist", "errorVerbose": "file does not exist\n\tstorj.io/common/rpc/rpcstatus.Wr
ap:76\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:687\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:302\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpc
tracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:167\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:109\n\tstorj.io/drpc/dr
pcserver.(*Server).Serve.func2:157\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}

I don’t know what the problem is…

Vadim · May 8, 2024, 12:18pm

check connection to hdd, does it open files, have any errors?

Dr.Ko · May 8, 2024, 12:33pm

HDD is connected. As shown in the log, the download continues, but there is no change in Ingress.

Vadim · May 8, 2024, 12:55pm

Error mean that there is problem, and download pieses not working, audit error, this mean you can soon get DQ

pangolin · May 8, 2024, 1:02pm

I had a similar problem several times. I don’t know the reason but a node restart always solved it.

Dr.Ko · May 8, 2024, 1:10pm

oh… It’s scary DQ…
(20 characters)

Dr.Ko · May 8, 2024, 1:10pm

as you said I decided to start again. I hope there is hope…

Dr.Ko · May 9, 2024, 2:24am

I don’t know why, but after restarting, I received it without a problem for 12 hours. thank you!

jammerdan · May 9, 2024, 2:31am

Genie · May 9, 2024, 3:48am

I guess no ingress traffic while online score was under 80%.

Dr.Ko · May 9, 2024, 5:08am

My online score is under 80, but I am receiving it after restarting. It’s probably for another reason.

Alexey · May 9, 2024, 7:26am

No, the current threshold is 60% for Online and Suspension scores.
More like a similar (still unknown) issue pointed by @jammerdan