Dashboard port 14002 closed

fdigennaro · April 18, 2022, 9:18am

Hi,
everything is configured well, in my router the portforwarding is correct, the port in the linux firewall is allowed, but remains closed.
I had to restore the database, and now the web dashboard doesn’t work.
The dashboard node from cli appears online.
I have many errors like these:

2022-04-18T09:16:24.028Z        ERROR   piecestore      download failed {"Piece ID": "LWTDUGGKSS7PJIA3FWZYSVPVG7PS3VOQ3CYSGFP7E3JZBRD7IRXQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "error": "pieces error: filestore error: unable to open \"config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/lw/tduggkss7pjia3fwzysvpvg7ps3voq3cysgfp7e3jzbrd7irxq.sj1\": open config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/lw/tduggkss7pjia3fwzysvpvg7ps3voq3cysgfp7e3jzbrd7irxq.sj1: permission denied", "errorVerbose": "pieces error: filestore error: unable to open \"config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/lw/tduggkss7pjia3fwzysvpvg7ps3voq3cysgfp7e3jzbrd7irxq.sj1\": open config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/lw/tduggkss7pjia3fwzysvpvg7ps3voq3cysgfp7e3jzbrd7irxq.sj1: permission denied\n\tstorj.io/storj/storage/filestore.(*Dir).Open:279\n\tstorj.io/storj/storage/filestore.(*blobStore).Open:75\n\tstorj.io/storj/storagenode/pieces.(*Store).Reader:262\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:542\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:228\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:58\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:122\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:112\n\tstorj.io/drpc/drpcctx.(*Tracker).track:52"}
2022-04-18T09:16:25.189Z        ERROR   piecestore      download failed {"Piece ID": "APNKRCEFS2QTUKONYQUY4BMGHXZ7FU6BJSQSPVIKFH7FJRYJSF2A", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "error": "pieces error: filestore error: unable to open \"config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/ap/nkrcefs2qtukonyquy4bmghxz7fu6bjsqspvikfh7fjryjsf2a.sj1\": open config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/ap/nkrcefs2qtukonyquy4bmghxz7fu6bjsqspvikfh7fjryjsf2a.sj1: permission denied", "errorVerbose": "pieces error: filestore error: unable to open \"config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/ap/nkrcefs2qtukonyquy4bmghxz7fu6bjsqspvikfh7fjryjsf2a.sj1\": open config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/ap/nkrcefs2qtukonyquy4bmghxz7fu6bjsqspvikfh7fjryjsf2a.sj1: permission denied\n\tstorj.io/storj/storage/filestore.(*Dir).Open:279\n\tstorj.io/storj/storage/filestore.(*blobStore).Open:75\n\tstorj.io/storj/storagenode/pieces.(*Store).Reader:262\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:542\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:228\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:58\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:122\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:112\n\tstorj.io/drpc/drpcctx.(*Tracker).track:52"}
2022-04-18T09:16:28.412Z        ERROR   piecestore      download failed {"Piece ID": "RUEFR4JFDNMOQP7C2MRD5VUSYXVI4NPPW35T5U3U2VJUIHUUBPIQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "error": "pieces error: filestore error: unable to open \"config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/ru/efr4jfdnmoqp7c2mrd5vusyxvi4nppw35t5u3u2vjuihuubpiq.sj1\": open config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/ru/efr4jfdnmoqp7c2mrd5vusyxvi4nppw35t5u3u2vjuihuubpiq.sj1: permission denied", "errorVerbose": "pieces error: filestore error: unable to open \"config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/ru/efr4jfdnmoqp7c2mrd5vusyxvi4nppw35t5u3u2vjuihuubpiq.sj1\": open config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/ru/efr4jfdnmoqp7c2mrd5vusyxvi4nppw35t5u3u2vjuihuubpiq.sj1: permission denied\n\tstorj.io/storj/storage/filestore.(*Dir).Open:279\n\tstorj.io/storj/storage/filestore.(*blobStore).Open:75\n\tstorj.io/storj/storagenode/pieces.(*Store).Reader:262\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:542\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:228\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:58\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:122\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:112\n\tstorj.io/drpc/drpcctx.(*Tracker).track:52"}

skookum · April 18, 2022, 11:05am

There’s a “permission denied” buried in those errors. Check that the owner and group of your files matches the user that you’ve declared in your docker run command or docker-compose file.

fdigennaro · April 18, 2022, 12:55pm

I understood a permissions issue, but can’t figure out how to fix it.
I ended up with the bandwidth.db file belonging to the root user, I think this is wrong.

skookum · April 18, 2022, 2:34pm

It depends if your node is running as root. Can you share the directory listing where bandwidth.db is? What docker run command are you using?

fdigennaro · April 18, 2022, 3:58pm

This is my docker run command:

docker run -d --restart unless-stopped --stop-timeout 300
-p 28967:28967/tcp
-p 28967:28967/udp
-p 127.0.0.1:14002:14002
-e WALLET=“naked”
-e EMAIL=“naked”
-e ADDRESS=“naked:28967”
-e STORAGE=“7TB”
–user $(id -u):$(id -g)
–mount type=bind,source=“/media/storj/storagenode”,destination=/app/identity
–mount type=bind,source=“/media/storj/storage”,destination=/app/config
–name storagenode storjlabs/storagenode:latest

Path of bandwidth.db is : /media/storj/storage/storage

fdigennaro · April 18, 2022, 5:33pm

I think I messed up, how can I check the whole node ?
Running these command:

docker exec -it storagenode /app/dashboard.sh

node seems online

sudo lsof -i -P -n | grep 14002

but dashboard port resulting closed

2022-04-18T17:32:23.084Z        ERROR   piecestore      download failed {"Piece ID": "UVD5Q7HLXLPC5N3JIYISSYLPQMAKZNISEQRQ6XKCQAXEJ7JGP37Q", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "error": "pieces error: filestore error: unable to open \"config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/uv/d5q7hlxlpc5n3jiyissylpqmakzniseqrq6xkcqaxej7jgp37q.sj1\": open config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/uv/d5q7hlxlpc5n3jiyissylpqmakzniseqrq6xkcqaxej7jgp37q.sj1: permission denied", "errorVerbose": "pieces error: filestore error: unable to open \"config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/uv/d5q7hlxlpc5n3jiyissylpqmakzniseqrq6xkcqaxej7jgp37q.sj1\": open config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/uv/d5q7hlxlpc5n3jiyissylpqmakzniseqrq6xkcqaxej7jgp37q.sj1: permission denied\n\tstorj.io/storj/storage/filestore.(*Dir).Open:279\n\tstorj.io/storj/storage/filestore.(*blobStore).Open:75\n\tstorj.io/storj/storagenode/pieces.(*Store).Reader:262\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:542\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:228\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:58\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:122\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:112\n\tstorj.io/drpc/drpcctx.(*Tracker).track:52"}

A lot of this error, “permission denied”

Running this command: docker exec -it storagenode /app/storagenode dashboard

Result:

2022-04-18T17:36:45.212Z        FATAL   Failed to load identity.        {"error": "file or directory not found: open /.local/share/storj/identity/storagenode/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open /.local/share/storj/identity/storagenode/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:329\n\tmain.cmdDashboard:52\n\tstorj.io/private/process.cleanup.func1.4:363\n\tstorj.io/private/process.cleanup.func1:381\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfig:88\n\tstorj.io/private/process.ExecCustomDebug:70\n\tmain.main:474\n\truntime.main:255"}

What do I need to check again?

skookum · April 18, 2022, 5:56pm

As for the dashboard, if you are trying to access it from a different host other than your node then it looks like the issue has to do with your docker command. Change this:

‘127.0.0.1:14002:14002‘

To:

‘ 14002:14002’

so that the dashboard is accessible outside of localhost.

I want to add that there’s no reason to port forward 14002 on your router if you are on the same local network. If you are seeking remote access to it then I recommend using a VPN to first connect to your local network.

fdigennaro · April 18, 2022, 6:06pm

this is not the problem the dashboard is not accessible from my lan and not even remotely by public ip

skookum · April 18, 2022, 6:14pm

Local network is different than localhost. The way you are currently running the docker container only allows access to the dashboard from the very same host. Removing the 127.0.0.1 will tell docker to forward traffic that is received from outside of the localhost to the container on port 14002.