Dear Storj,
I don’t know why out of nowhere the storj is offline. I tired restarting my PC and restart the node but nothing is working out. Please advise something on this matter immediately.
I even check the ports on youget signal and it is open. And here are the logs for my node.
2023-08-12T07:36:36Z INFO Current binary version {“Process”: “storagenode-updater”, “Service”: “storagenode-updater”, “Version”: “v1.85.1”}
2023-08-12T07:36:36Z INFO Version is up to date {“Process”: “storagenode-updater”, “Service”: “storagenode-updater”}
2023-08-12T07:36:49Z ERROR contact:service ping satellite failed {“process”: “storagenode”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “attempts”: 10, “error”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out”, “errorVerbose”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75”}
2023-08-12T07:36:55Z ERROR contact:service ping satellite failed {“process”: “storagenode”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “attempts”: 8, “error”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out”, “errorVerbose”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75”}
2023-08-12T07:38:02Z ERROR contact:service ping satellite failed {“process”: “storagenode”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “attempts”: 7, “error”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out”, “errorVerbose”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75”}
2023-08-12T07:38:56Z ERROR contact:service ping satellite failed {“process”: “storagenode”, “Satellite ID”: “1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE”, “attempts”: 10, “error”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out”, “errorVerbose”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75”}
2023-08-12T07:41:16Z ERROR contact:service ping satellite failed {“process”: “storagenode”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “attempts”: 9, “error”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out”, “errorVerbose”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75”}
2023-08-12T07:41:19Z ERROR contact:service ping satellite failed {“process”: “storagenode”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “attempts”: 8, “error”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out”, “errorVerbose”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75”}
2023-08-12T07:45:18Z ERROR contact:service ping satellite failed {“process”: “storagenode”, “Satellite ID”: “12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo”, “attempts”: 11, “error”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out”, “errorVerbose”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75”}
2023-08-12T07:45:18Z ERROR contact:service ping satellite failed {“process”: “storagenode”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “attempts”: 11, “error”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out”, “errorVerbose”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75”}
2023-08-12T07:45:37Z ERROR contact:service ping satellite failed {“process”: “storagenode”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “attempts”: 9, “error”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out”, “errorVerbose”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75”}
2023-08-12T07:47:32Z ERROR contact:service ping satellite failed {“process”: “storagenode”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “attempts”: 11, “error”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out”, “errorVerbose”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75”}
2023-08-12T07:47:45Z ERROR contact:service ping satellite failed {“process”: “storagenode”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “attempts”: 10, “error”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out”, “errorVerbose”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75”}
2023-08-12T07:49:39Z ERROR contact:service ping satellite failed {“process”: “storagenode”, “Satellite ID”: “1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE”, “attempts”: 11, “error”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out”, “errorVerbose”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75”}
2023-08-12T07:51:33Z INFO Downloading versions. {“Process”: “storagenode-updater”, “Server Address”: “https://version.storj.io”}
2023-08-12T07:51:36Z INFO Current binary version {“Process”: “storagenode-updater”, “Service”: “storagenode”, “Version”: “v1.85.1”}
2023-08-12T07:51:36Z INFO Version is up to date {“Process”: “storagenode-updater”, “Service”: “storagenode”}
2023-08-12T07:51:37Z INFO Current binary version {“Process”: “storagenode-updater”, “Service”: “storagenode-updater”, “Version”: “v1.85.1”}
2023-08-12T07:51:37Z INFO Version is up to date {“Process”: “storagenode-updater”, “Service”: “storagenode-updater”}
2023-08-12T07:52:04Z ERROR contact:service ping satellite failed {“process”: “storagenode”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “attempts”: 10, “error”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out”, “errorVerbose”: “ping satellite: failed to ping storage node, your node indicated error code: 0, rpc: tcp connector failed: rpc: dial tcp 122.254.90.128:28967: connect: connection timed out\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:209\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:157\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:99\n\tstorj.io/common/sync2.(*Cycle).Start.func1:77\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:75”}
That’s only mean that provided external address and port is not available from outside.
You may always check it in your browser: http://<your external address>:28967
If it’s not available (and it’s), you need to check your WAN IP and IP on Open Port Check Tool - Test Port Forwarding on Your Router and compare them.
If they do not match - your ISP did switch you behind their NAT (CGNAT), so you need to contact them and ask to make it available again.
You need also check that the local IP of your host is still the same, as specified in the port forwarding rule on your router. If not, you need to update it, and also make sure it will not change in the future, and make it static (usually in the DHCP section on your router).
The IP address match. But still I am offline.
Then check every point from this list (docker):
or
in case of Windows GUI.
It’s also worth to check your logs for the fatal errors: How do I check my logs? - Storj Docs
I did a DHCP reservation of my local IP too and mac mapping during port-forwading setup.
1 Like
But please also check everything else from these check-lists
My IP address is not matching the IP address shown in the nslookup command. what should I do next? Only yesterday, I was able to setup DDNS in the router settings. Otherwise I was using noip DUIC. Now, I am using dipc service instead of noip.
Update your DDNS hostname and fix the issue why it did not update automatically
Great! Now I cannot even access my Node Dashboard.
This could be because they stopped or restarting. You need to check logs to figure out what’s the reason.
Here are the logs:
2023-08-13 04:49:50,818 INFO success: processes-exit-eventlistener entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-08-13T04:49:50Z INFO Current binary version {“Process”: “storagenode-updater”, “Service”: “storagenode-updater”, “Version”: “v1.85.1”}
2023-08-13T04:49:50Z INFO Version is up to date {“Process”: “storagenode-updater”, “Service”: “storagenode-updater”}
2023-08-13 04:49:50,829 INFO success: storagenode-updater entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-08-13 04:49:51,834 INFO spawned: ‘storagenode’ with pid 39
2023-08-13T04:49:51Z INFO Configuration loaded {“process”: “storagenode”, “Location”: “/app/config/config.yaml”}
2023-08-13T04:49:51Z INFO Anonymized tracing enabled {“process”: “storagenode”}
2023-08-13T04:49:51Z INFO Operator email {“process”: “storagenode”, “Address”: “dhiwara@gmail.com”}
2023-08-13T04:49:51Z INFO Operator wallet {“process”: “storagenode”, “Address”: “0xd9eaf647598dED7F6D1dE05CeFB9ACD2B81738a2”}
2023-08-13T04:49:51Z ERROR Invalid configuration. {“process”: “storagenode”, “error”: “invalid contact.external-address: lookup "xachinxungur.ddnsfree.net" failed: lookup xachinxungur.ddnsfree.net on 192.168.101.1:53: no such host”, “errorVerbose”: “invalid contact.external-address: lookup "xachinxungur.ddnsfree.net" failed: lookup xachinxungur.ddnsfree.net on 192.168.101.1:53: no such host\n\tstorj.io/storj/storagenode.(*Config).Verify:165\n\tmain.cmdRun:57\n\tmain.newRunCmd.func1:32\n\tstorj.io/private/process.cleanup.func1.4:399\n\tstorj.io/private/process.cleanup.func1:417\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomOptions:113\n\tmain.main:30\n\truntime.main:250”}
Error: invalid contact.external-address: lookup “xachinxungur.ddnsfree.net” failed: lookup xachinxungur.ddnsfree.net on 192.168.101.1:53: no such host
2023-08-13 04:49:51,917 INFO exited: storagenode (exit status 1; not expected)
2023-08-13 04:49:53,924 INFO spawned: ‘storagenode’ with pid 46
2023-08-13T04:49:53Z INFO Configuration loaded {“process”: “storagenode”, “Location”: “/app/config/config.yaml”}
2023-08-13T04:49:53Z INFO Anonymized tracing enabled {“process”: “storagenode”}
2023-08-13T04:49:53Z INFO Operator email {“process”: “storagenode”, “Address”: “dhiwara@gmail.com”}
2023-08-13T04:49:53Z INFO Operator wallet {“process”: “storagenode”, “Address”: “0xd9eaf647598dED7F6D1dE05CeFB9ACD2B81738a2”}
2023-08-13T04:49:54Z ERROR Invalid configuration. {“process”: “storagenode”, “error”: “invalid contact.external-address: lookup "xachinxungur.ddnsfree.net" failed: lookup xachinxungur.ddnsfree.net on 192.168.101.1:53: no such host”, “errorVerbose”: “invalid contact.external-address: lookup "xachinxungur.ddnsfree.net" failed: lookup xachinxungur.ddnsfree.net on 192.168.101.1:53: no such host\n\tstorj.io/storj/storagenode.(*Config).Verify:165\n\tmain.cmdRun:57\n\tmain.newRunCmd.func1:32\n\tstorj.io/private/process.cleanup.func1.4:399\n\tstorj.io/private/process.cleanup.func1:417\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomOptions:113\n\tmain.main:30\n\truntime.main:250”}
Error: invalid contact.external-address: lookup “xachinxungur.ddnsfree.net” failed: lookup xachinxungur.ddnsfree.net on 192.168.101.1:53: no such host
2023-08-13 04:49:54,010 INFO exited: storagenode (exit status 1; not expected)
Your Ddns service is returning a private internal IP address, not a public one. Re-check how the Ddns service updates.
At least the node dashboard should have shown, isn’t it? Even if DDNS is not working.
This is mean that this hostname cannot be resolved to an IP by your local DNS on 192.168.101.1
But it also unknown for the other DNS servers. Looks like this domain is not registered.
You may access it on the host, where is node running. But it depends on your configuration.
Please show your docker run command, you may mask your private info.
Probably the problem was I didn’t configure the hostname with ipv6 too in noip.
It’s unrelated. This hostname is simple doesn’t exist for all DNS servers in the Internet.
Please note, IPv6-only node will be offline, you must have a public IPv4, not only IPv6.
nslookup xachinxungur.ddnsfree.net 8.8.8.8
Server: dns.google
Address: 8.8.8.8
*** dns.google can't find xachinxungur.ddnsfree.net: Non-existent domain
There is a field for port in the DDNS option on the router access page. Should I fill out the number 28967 of storj or 8245 of noip?
You should configure it accordingly their documentation. You must not use the node’s port though, because your node doesn’t serve on their servers and it also doesn’t designed to work as a DDNS server.
Make sure that your DDNS client on the router is compatible with your DDNS provider. *ddnsfree.net doesn’t belongs to NoIp, it seems belongs to Dynu.
Apparently I changed the DDNS to noip. So which port should I use in DDNS settings?
And also I got the information that the free DDNS service from noip.com should be configured by selecting on the field of dyndns service. And the noip field is only for paid users. Is it true?