Node offline and QUIC misconfigured

Node Operators troubleshooting
, , , ,
1

I’m setting up for the first time today, and it doesn’t work properly.

I followed the most recent instructions, so I’m already using

    -p 28967:28967/tcp \
    -p 28967:28967/udp \

I have restarted docker multiple multiple multiple multiple times. It. does. not. help.

I have confirmed that port forwarding is enabled in my router for both tcp/udp.

Opening the dashboard in an incognito window, I have this:

image
image1797×837 62.7 KB

What further troubleshooting is available? I’m seeing the same advice over and over, none of it has helped me.

I’ve run docker stop and docker rm on the container around 15 times today trying to get this set up.

Either your application is broken, or your instructions are incorrect.

I’m on Linux.

Is there any advice that you can provide that isn’t just a repeat of 100 other posts that all say the same thing, which I’ve already tried without any success?

2

image
image1094×196 14 KB

Sorry, new users can only embed one image per post.

3

image
image716×575 33.7 KB

Sorry, new users can only embed one image per post.

 ╰─λ docker --version
Docker version 20.10.16, build aa7e414fdc

and

 ╰─λ docker ps -a
CONTAINER ID   IMAGE                          COMMAND         CREATED          STATUS          PORTS                                                                                                                                         NAMES
90a27996837c   storjlabs/storagenode:latest   "/entrypoint"   21 minutes ago   Up 21 minutes   0.0.0.0:14002->14002/tcp, :::14002->14002/tcp, 0.0.0.0:28967->28967/tcp, :::28967->28967/tcp, 0.0.0.0:28967->28967/udp, :::28967->28967/udp   storagenode

I’m running

docker run -d --restart unless-stopped --stop-timeout 300 \
    -p 28967:28967/tcp \
    -p 28967:28967/udp \
    -p 14002:14002 \
    -e WALLET="0xXXXXXXXX" \
    -e EMAIL="XXXXXX@gmail.com" \
    -e ADDRESS="XXXXXX:28967" \
    -e STORAGE="2TB" \
    --user $(id -u):$(id -g) \
    --mount type=bind,source=/storjnode/storagenode,destination=/app/identity \
    --mount type=bind,source=/storjnode,destination=/app/config \
    --name storagenode storjlabs/storagenode:latest

For IP address, I’m providing my actual public IP address. Once I get that working, I’ll switch to a service like noip or duckdns. I just want to see this work once, with as simple a config as possible.

4

Hello @mattzab ,
Welcome to the forum!

Please check your identity: Identity | Storj Docs

5 
 ╭─root@arch in / took 2s
 ╰─λ grep -c BEGIN /storjconfig/storagenode/ca.cert
2

 ╭─root@arch in / took 3ms
 ╰─λ grep -c BEGIN /storjconfig/storagenode/identity.cert
3

 ╭─root@arch in / took 27ms
 ╰─λ docker stop a61bcf54841d
a61bcf54841d

 ╭─root@arch in / took 736ms
 ╰─λ docker rm a61bcf54841d
a61bcf54841d

 ╭─root@arch in / took 6s
 ╰─λ docker run -d --restart unless-stopped --stop-timeout 300 \
             -p 28967:28967/tcp \
             -p 28967:28967/udp \
             -p 14002:14002 \
             -e WALLET=0xCxxxxxxxxxxxxxxxxxxxxxxxxx \
             -e EMAIL=xxxxx@gmail.com \
             -e ADDRESS=10x.xxx.xx.xx:28967 \
             -e STORAGE=2TB \
             --user $(id -u):$(id -g) \
             --mount type=bind,source=/storjconfig/storagenode,destination=/app/identity \
             --mount type=bind,source=/storjnode,destination=/app/config \
             --name storagenode storjlabs/storagenode:latest


12fe2f954a7a4a9fc795decd01b6dcd03165acbe261139cbaad2a2b9dd0b05f4

image
image1757×1033 70.6 KB

What can I try next?

Now it says that my node is outdated, and I need to upgrade to v.

Ok, how do I do that? I’m pretty sure I’m running latest everything

6

image
image825×297 24.8 KB

Sorry, new users can only attach one media per post.

7

I will completely start over, from step 1.

If any step causes an error, I will post it.

8

This is not needed. Your node seems doesn’t work (perhaps restarting), thus your web-dashboard doesn’t show real values. It also possible that your browser blocking some content (rare case), js for example.
Please provide the last 20 lines from your logs: How do I check my logs? | Storj Docs

Please try also to use a local dashboard

docker exec -it storagenode ./dashboard.sh
9 
 ╭─root@arch in / took 767ms
 ╰─λ docker exec -it storagenode ./dashboard.sh
2022-05-15T07:20:00.277Z	INFO	Configuration loaded	{"Process": "storagenode", "Location": "/app/config/config.yaml"}
2022-05-15T07:20:00.278Z	INFO	Identity loaded.	{"Process": "storagenode", "Node ID": "eilustfxhukljk;dK"}
Error: rpc: dial tcp 127.0.0.1:7778: connect: connection refused
10

goroutine 36 [chan receive]:
storj.io/private/process.Ctx.func1()
/go/pkg/mod/storj.io/private@v0.0.0-20220411161553-f73cd1a48d5f/process/exec_conf.go:120 +0x3a
created by storj.io/private/process.Ctx
/go/pkg/mod/storj.io/private@v0.0.0-20220411161553-f73cd1a48d5f/process/exec_conf.go:119 +0x2de

goroutine 35 [syscall]:
os/signal.signal_recv()
/usr/local/go/src/runtime/sigqueue.go:169 +0x98
os/signal.loop()
/usr/local/go/src/os/signal/signal_unix.go:24 +0x19
created by os/signal.Notify.func1.1
/usr/local/go/src/os/signal/signal.go:151 +0x2c

goroutine 37 [select]:
database/sql.(*DB).connectionOpener(0xc000428680, {0x137f1f8, 0xc00012a9c0})
/usr/local/go/src/database/sql/sql.go:1196 +0x93
created by database/sql.OpenDB
/usr/local/go/src/database/sql/sql.go:794 +0x188
2022-05-15 07:44:19,472 INFO exited: storagenode (exit status 2; not expected)
2022-05-15 07:44:20,472 INFO gave up: storagenode entered FATAL state, too many start retries too quickly

11

storagenode does not work and throws exceptions. In this case 20 lines is not enough to show a full stack-trace.
Please try to provide an excerpt from logs since node start. You can use this service to upload archive with log file: https://transfer.sh/, you can replace a private information with placeholders.

12

Pointing me at logs was a huge help, thank you!
I’ve solved the problem- it was a small myriad of things due to restarting the process and having leftover config.yaml files with conflicting information, then also not enough space (I had unmounted my external storage while troubleshooting), etc.

If I had been reading those logs from the start, I would have saved myself a decent amount of trouble. They made all the difference.

I think the panic it experienced at the end was simply an anomaly.

I’m up and running now, thank you for your troubleshooting advice! Whew!

1 Like