Stefan-benten satellite down?

hewicker · January 16, 2020, 3:25pm

As of a few minutes ago I am getting Ping errors Like this:

`2020-01-16T15:17:34.743Z        ERROR   contact:chore   ping satellite failed   {"Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "attempts": 11, "error": "ping satellite error: rpccompat: dial tcp 78.94.240.189:7777: connect: connection refused", "errorVerbose": "ping satellite error: rpccompat: dial tcp 78.94.240.189:7777: connect: connection refused\n\tstorj.io/common/rpc.Dialer.dialTransport:242\n\tstorj.io/common/rpc.Dialer.dial:219\n\tstorj.io/common/rpc.Dialer.DialAddressID:138\n\tstorj.io/storj/storagenode/contact.(*Chore).pingSatelliteOnce:154\n\tstorj.io/storj/storagenode/contact.(*Chore).pingSatellite:124\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:103\n\tstorj.io/common/sync2.(*Cycle).Run:87\n\tstorj.io/common/sync2.(*Cycle).Start.func1:68\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57"}`

It seems to me the stefan-benten.de satellite is down. Can anybody confirm or should I be looking for a problem on my end?

deathlessdd · January 16, 2020, 3:27pm

Yup its down right now, Its not on your end.

kbch · January 16, 2020, 3:32pm

Same for me, satellite down and massive traffic drop on my node.

JoshGarza · January 16, 2020, 3:37pm

Only real traffic right now

hewicker · January 16, 2020, 4:21pm

Thanks for the quick replies. I had some issues with my storagenode today and was not sure if I broke something. Let’s hope it comes back up again and the traffic resumes…

eagleye · January 16, 2020, 4:22pm

Yup,

Same here. Lots of errors as satellite is unreachable

Vadim · January 16, 2020, 4:32pm

May be it is on update as was told before, storj is mooving to other database on some point this month.
In this case Announcment will prevent panic, as Sattelites supposed to be not kilable.

Pavmer · January 16, 2020, 4:44pm

The traffic was restored for a short time, and again disappeared…

Apparently, there are some structural changes, most likely related to the launch of production.

eagleye · January 16, 2020, 4:58pm

looks like it’s back up and running here.

hewicker · January 16, 2020, 5:12pm

Yes, same here. Seems to be back to normal for now.

donald.m.motsinger · January 16, 2020, 5:25pm

Found this in the changelog

Satellite migration to cockroach
Next week we are going to migrate the satellite databases to cockroach one by one. You will notice order sender errors and checkin errors doing the downtime. Keep an eye on the announcement channel.

Let us know if you want to help us testing everything. Storj-sim is able to connect to a cockroach cluster.

littleskunk · January 16, 2020, 5:43pm

It was a connection leak. I will have to run some tests to find the reason. Don’t worry the tardigrade satellite will automatically restart so that customers will not notice it. Stefan is running his satellite without that because otherwise we woudn’t even notice these kind of bugs.

direktorn · January 16, 2020, 8:22pm

Interesting that this satellite is down the same day as my node is down

Vadim · January 16, 2020, 8:23pm

then it shold be your fault

direktorn · January 17, 2020, 10:56am

indeed ----------

fikros · January 17, 2020, 5:32pm

I think it’s down again.

Vadim · January 17, 2020, 5:37pm

looks like all trafic gone yes.

kbch · January 17, 2020, 5:46pm

Same here, no traffic atm and

2020-01-17T17:44:15.710ZDEBUGgracefulexit:chorechecking pending exits
2020-01-17T17:44:15.710ZDEBUGgracefulexit:choreno satellites found
2020-01-17T17:44:16.215ZDEBUGversionallowed minimum version from control server is: v0.28.0

MadeInGermany · January 17, 2020, 9:59pm

Here too. Get Online Rating of 0% from this Server

MadeInGermany · January 18, 2020, 8:22am

Is the service still offline?