SNO Board not working due to untrusted satellite

When opening my SNO Board I get following error in ajax call to /api/sno/:
error: storageNode console web error: storage node dashboard service error: trust: satellite “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW” is untrusted

I am running latest version on docker/linux.

Anyone else having this issue?

3 Likes

However my dashboard loads normally without visible issues. When you see that error?

My nodes now “crash” as well. Dashboard shows absolutely nothing anymore and log is full with:

2020-09-16T21:13:08.039Z        ERROR   contact:service ping satellite failed   {"Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "attempts": 10, "error": "ping satellite error: trust: satellite \"118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW\" is untrusted", "errorVerbose": "ping satellite error: trust: satellite \"118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW\" is untrusted\n\tstorj.io/storj/storagenode/trust.(*Pool).getInfo:228\n\tstorj.io/storj/storagenode/trust.(*Pool).GetNodeURL:167\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:119\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:95\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/common/sync2.(*Cycle).Start.func1:71\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57"}

Despite that however, the node is still online and doing its job, so it is a dashboard bug.

At least the CLI dashboard doesn’t suffer from that bug:
grafik

(For now it seems to only affect the one node that didn’t GE on stefan-benten. However, the other nodes still show the log error although they did a GE on stefan-benten and imho shouldn’t even contact that satellite anymore)

So I guess you might want to rethink shutting down stefan-benten satellite until you fix the dashboard :wink:

1 Like

Seeing similar with storj-exporter - storagenode api returns the following for api/sno/ call:

# curl -s http://127.0.0.1:14011/api/sno/ | jq
{
  "error": "storageNode console web error: storage node dashboard service error: trust: satellite \"118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW\" is untrusted"
}

I guess dashboard relies on this api

1 Like

I have 2 SNO, exacrtly same setup.
And 1 experiences exactly the same issue

I did not GE on any satellite and all my nodes have broken SNO board just like in screenshots above.

Seems like issue is just in sno board, however a lot of less technical user believe what they see on SNO board and think their node is broken. Get ready for the “My node is broken” storm

1 Like

Me too!

storageNode console web error: storage node dashboard service error: trust: satellite “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW” is untrusted

As noted here Web Dashboard = Offline - Local Dashboard = Online

FWIW, I got this failure mode as well.

I run 6 nodes. All of them are running the same docker image but this failure mode only occurred on one of them. Restarting the node does not help.

1 Like

same here, dashboard cli works fine gui version shows node offline, node registered last month

http://storjnet.info/ reports one satellite to be down. Is it the reason for the error?

https://satellite.stefan-benten.de/

has been officially shutdown.

restarted SNO, and now it is working, ONLINE

My node appears to be operating normally based on the logs I’m seeing in the console (shown below) it seems to be receiving and sending data…

storj                   | 2020-09-16T21:50:32.057Z      INFO    piecestore      upload started  {"Piece ID": "JXKRKWXGRA6NBP353WHIDLCHIRXUZ3ESTJKEWN62CPPCW7LI5NIQ", "Satellite ID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB", "Action": "PUT", "Available Space": 1995039876864}
storj                   | 2020-09-16T21:50:32.122Z      INFO    piecestore      uploaded        {"Piece ID": "JXKRKWXGRA6NBP353WHIDLCHIRXUZ3ESTJKEWN62CPPCW7LI5NIQ", "Satellite ID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB", "Action": "PUT"}
storj                   | 2020-09-16T21:50:45.414Z      INFO    piecestore      upload started  {"Piece ID": "RNL6CIX3HYVI2AUGHGGKGJJBLUEBMJUNBG2COZX5LZWAMHTA6SHA", "Satellite ID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Action": "PUT_REPAIR", "Available Space": 1995039875584}
storj                   | 2020-09-16T21:50:53.050Z      INFO    piecestore      upload started  {"Piece ID": "6DHJNI6LSLIDAEG7O7V2F7XUGRHJYEIGP6MJJTWV6XP64MMV5OEQ", "Satellite ID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Action": "PUT_REPAIR", "Available Space": 1995039875584}
storj                   | 2020-09-16T21:50:54.644Z      INFO    piecestore      upload started  {"Piece ID": "ZCWPT3HYBBQRQXEVZR7IVD5TIKO7M7NNLKXAIQKQPOIXJKNRHOIA", "Satellite ID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB", "Action": "PUT", "Available Space": 1995039875584}

but the dashboard indicates that the node is offline

you’ll also notice that the Node ID and other information is missing.

when I look in the JavaScript console to diagnose the issue I see that I am actually getting some errors

Failed to load resource: the server responded with a status of 500 (Internal Server Error)
app_53be096dc69d96547f33.js:1 Uncaught (in promise) Error: Internal Server Error
    at app_53be096dc69d96547f33.js:1
    at l (vendors_53be096dc69d96547f33.js:37)
    at Generator._invoke (vendors_53be096dc69d96547f33.js:37)
    at Generator.forEach.e.<computed> [as next] (vendors_53be096dc69d96547f33.js:37)
    at SO (app_53be096dc69d96547f33.js:1)
    at a (app_53be096dc69d96547f33.js:1)

can anyone help me sort this out / get my dashboard working again?

Thanks :slight_smile:

Hi, I have the same problem. In the dashboard is offline but in the logs show that run well. If try the api call api/sno display this response:

“error”: “storageNode console web error: storage node dashboard service error: trust: satellite "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW" is untrusted”

just to add on I’ve tested that API call and get the same error, seems this is a common issue. (I am running docker in linux like ferdinandpc)

Looks like problem is that StefenBenten is down/turned off, this reviled some bug in node system, as long it is in the node satelite cash it will show problems

Hi All,

I just checked my Node and nearly had a heart attack when I saw this:

I logged into the node to double check and I get this:
image

I restarted the node before the second picture to see if that would fix the Dashboard in the browser but it didn’t!

Do I need to worry about this or will it correct itself?

Thanks

1 Like

Clear your cache Ctrl F5