Email saying my node is still offline

Node Operators troubleshooting
1

Hi all !

I have received my third email saying my node is still offline. When I check my node dashboard the numbers changed et it say I am online and with a uptime of 36h. My node version is 0.34.6.
But my log at /var/log/storj_reports.log say “Settings File Not Found. Exiting.”. Even if the file at /etc/storjdash.json is here and not corrupted.

Any thought on this issue ? I’m out of idea.

2

did you made some new nodes or was dq and made new node?
Check does node id on email and your node is tha same?

3

Hello @phastens,
Welcome to the forum!

The storjdash is a third party tool made by a community member a while ago for v2.
I do not have any information, is it compatible with the v3 network. I think, no. Then it’s better to remove it.
Please, provide 20 lines of log for the storagenode:

docker logs --tail 20 storagenode
4

I had to remove docker containers because he went crazy and used 100% of my cpu.

5

I had to remove docker containers because he went crazy and used 100% of my cpu.

I am a long time node operator. I will remove that.

Here is my logs (Sorry for the link to nowhere, the editor had detected links and i was unable to post this message):

2020-03-14T09:01:23.635Z INFO piecestore upload started {“Piece ID”: “SGCN6G4LC2BKZFQ2ZQBI3DHBFKFFWEW3VEIYZB7ZE3P3L3SRRR4A”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “Action”: “PUT”, “Available Bandwidth”: 99778076473088, “Available Space”: 761614411392}
2020-03-14T09:01:23.701Z INFO piecestore uploaded {“Piece ID”: “SGCN6G4LC2BKZFQ2ZQBI3DHBFKFFWEW3VEIYZB7ZE3P3L3SRRR4A”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “Action”: “PUT”}
2020-03-14T09:01:23.968Z INFO piecestore deleted {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “6L3BXKY46AYYPNHB7FGPHKMDK77EBK4SJZ5LAUF343JMK2DCTWLA”}
2020-03-14T09:01:24.416Z INFO piecestore upload started {“Piece ID”: “BASWRTSBP5CSPX67BPIEGK6R4HEQUYKHADGFNTHUZHFTYH75FW4Q”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”, “Available Bandwidth”: 99778076454912, “Available Space”: 761616710272}
2020-03-14T09:01:26.186Z INFO piecestore upload started {“Piece ID”: “YS4B7MZGPPDGZ6WLVQXNV2XW7LFOYN2IHQ5TVCYKGD7FUMGMMNGQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”, “Available Bandwidth”: 99778076454912, “Available Space”: 761616710272}
2020-03-14T09:01:26.689Z INFO piecestore upload started {“Piece ID”: “I7DYCCND6PTH66V2TSZ6ZEBKQWNTI3NJD3PBSYYQBMGYN7OP6VWA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”, “Available Bandwidth”: 99778076454912, “Available Space”: 761616710272}
2020-03-14T09:01:27.619Z INFO piecestore upload canceled {“Piece ID”: “BASWRTSBP5CSPX67BPIEGK6R4HEQUYKHADGFNTHUZHFTYH75FW4Q”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”, “error”: “context canceled”, “errorVerbose”: “context canceled\n\tstorj.io/common/rpc/rpcstatus.Wrap:79\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).doUpload:461\n\tstorj.io/storj/storagenode/piecestore.(*drpcEndpoint).Upload:214\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:986\n\tstorj.io/drpc/drpcserver.(*Server).doHandle:199\n\tstorj.io/drpc/drpcserver.(*Server).HandleRPC:173\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:124\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:161\n\tstorj.io/drpc/drpcctx.(*Tracker).track:51”}
2020-03-14T09:01:27.697Z INFO piecestore download started {“Piece ID”: “44U6BQNIDSVWUCMZA7MH4RRU2K4MSFXQABXJSDHGRP3AL7MBIMBA”, “Satellite ID”: “1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE”, “Action”: “GET”}
2020-03-14T09:01:29.198Z INFO piecestore upload started {“Piece ID”: “A3GTHTLIAMSELLJLZTQ6JWXZFVGPBKCYAUX4OM7DOJR7UZCNQUYA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”, “Available Bandwidth”: 99778074137856, “Available Space”: 761614392704}
2020-03-14T09:01:29.410Z INFO piecestore upload started {“Piece ID”: “B7ZYEZK7HXMN36A277CSIG2W7Y4YG2G2JCJ6BEFPYH2HLOI4YIZA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”, “Available Bandwidth”: 99778074137856, “Available Space”: 761614392704}
2020-03-14T09:01:29.815Z INFO piecestore uploaded {“Piece ID”: “YS4B7MZGPPDGZ6WLVQXNV2XW7LFOYN2IHQ5TVCYKGD7FUMGMMNGQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”}
2020-03-14T09:01:29.867Z INFO piecestore uploaded {“Piece ID”: “A3GTHTLIAMSELLJLZTQ6JWXZFVGPBKCYAUX4OM7DOJR7UZCNQUYA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”}
2020-03-14T09:01:30.178Z INFO piecestore upload started {“Piece ID”: “O6DL5YPB26RAFHI22L7CKQRZVA3MD432CYPK3ZWQTZK6DWOI6IZQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”, “Available Bandwidth”: 99778069503744, “Available Space”: 761609757568}
2020-03-14T09:01:30.225Z INFO piecestore upload started {“Piece ID”: “6QUNI7SU2U2FKSJB7QTUR5RQT223TKVFWKSF34WZVWPHS2PPDHUA”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “Action”: “PUT”, “Available Bandwidth”: 99778069503744, “Available Space”: 761609757568}
2020-03-14T09:01:30.621Z INFO piecestore upload started {“Piece ID”: “LBVYCUZWUCJ2SE2ZHTYRTEFKICVFUPQKJ6W77SE4IPBNADCGZOVQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Bandwidth”: 99778069503744, “Available Space”: 761607440000}
2020-03-14T09:01:30.725Z INFO piecestore uploaded {“Piece ID”: “LBVYCUZWUCJ2SE2ZHTYRTEFKICVFUPQKJ6W77SE4IPBNADCGZOVQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-03-14T09:01:30.729Z INFO piecestore uploaded {“Piece ID”: “I7DYCCND6PTH66V2TSZ6ZEBKQWNTI3NJD3PBSYYQBMGYN7OP6VWA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”}
2020-03-14T09:01:30.913Z INFO piecestore uploaded {“Piece ID”: “O6DL5YPB26RAFHI22L7CKQRZVA3MD432CYPK3ZWQTZK6DWOI6IZQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”}
2020-03-14T09:01:30.986Z INFO piecestore uploaded {“Piece ID”: “6QUNI7SU2U2FKSJB7QTUR5RQT223TKVFWKSF34WZVWPHS2PPDHUA”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “Action”: “PUT”}
2020-03-14T09:01:32.645Z INFO piecestore upload canceled {“Piece ID”: “B7ZYEZK7HXMN36A277CSIG2W7Y4YG2G2JCJ6BEFPYH2HLOI4YIZA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”, “error”: “context canceled”, “errorVerbose”: “context canceled\n\tstorj.io/common/rpc/rpcstatus.Wrap:79\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).doUpload:461\n\tstorj.io/storj/storagenode/piecestore.(*drpcEndpoint).Upload:214\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:986\n\tstorj.io/drpc/drpcserver.(*Server).doHandle:199\n\tstorj.io/drpc/drpcserver.(*Server).HandleRPC:173\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:124\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:161\n\tstorj.io/drpc/drpcctx.(*Tracker).track:51”}

6

Thanks for the fast answering and for the welcoming :wink:
My log reply is currently hold for review.

7

Your node is working, I do not see any problem with restarts (one of the possible reason for blinking offline).
Please, compare the NodeId from the email with an actual NodeID

8

The node ID is the same in email received at 00:26 this morning and in the dashboard with an uptime of 44 hours. That’s why I’m confused. However, I only had warning email for US satellite at 00:26 and one for europe satellite at 23:15 yesterday. No more email since and not for Asia satellite.
Maybe a email timer that was not reset 44 hours ago ?

9

I would like to suggest you to use an uptimerobot.com for monitoring and you can check is it was offline or not.
Usually the email sent if your node offline

  1. after 4 hours of consecutively being offline
  2. 24 hours after the first email
  3. 48 hours after the second email
  4. 48 hours after the third email

So, there could be a problem either with your DDNS hostname or with ISP or with your node/PC. And this is was not a short period, as you can see

10

Ok, i’m gonna use an open source solutions for that.
Maybe my ISP add some issues in did.

Thanks for your time and your help !

1 Like