Offline after Setup

Node Operators troubleshooting
1

Hello,
my Node reports to be offline after the setup.
The port is open and reachable.

Log:
log”:“2019-11-25T19:07:09.593Z\u0009\u001b[34mINFO\u001b[0m\u0009Configuration loaded from: /app/config/config.yaml\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:09.593796833Z”}
{“log”:“2019-11-25T19:07:09.602Z\u0009\u001b[34mINFO\u001b[0m\u0009Operator email: XXXXXXXXXXXXXXX\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:09.602823719Z”}
{“log”:“2019-11-25T19:07:09.602Z\u0009\u001b[34mINFO\u001b[0m\u0009operator wallet: 0x47ecF400b027c5afDB5B597c19D82803bF448786\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:09.60285295Z”}
{“log”:“2019-11-25T19:07:13.069Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:13.070141085Z”}
{“log”:“2019-11-25T19:07:15.050Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.0\u0009Initial setup\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.05088948Z”}
{“log”:“2019-11-25T19:07:15.052Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.1\u0009Network Wipe #2\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.053023848Z”}
{“log”:“2019-11-25T19:07:15.053Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.2\u0009Add tracking of deletion failures.\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398486296Z”}
{“log”:“2019-11-25T19:07:15.053Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.3\u0009Add vouchersDB for storing and retrieving vouchers.\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398513902Z”}
{“log”:“2019-11-25T19:07:15.054Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.4\u0009Add index on pieceinfo expireation\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398520382Z”}
{“log”:“2019-11-25T19:07:15.055Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.5\u0009Partial Network Wipe - Tardigrade Satellites\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398526036Z”}
{“log”:“2019-11-25T19:07:15.055Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.6\u0009Add creation date.\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398531494Z”}
{“log”:“2019-11-25T19:07:15.056Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.7\u0009Drop certificate table.\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.39853678Z”}
{“log”:“2019-11-25T19:07:15.056Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.8\u0009Drop old used serials and remove pieceinfo_deletion_failed index.\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398542922Z”}
{“log”:“2019-11-25T19:07:15.057Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.9\u0009Add order limit table.\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398552704Z”}
{“log”:“2019-11-25T19:07:15.058Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.10\u0009Optimize index usage.\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398560872Z”}
{“log”:“2019-11-25T19:07:15.058Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.11\u0009Create bandwidth_usage_rollup table.\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398566752Z”}
{“log”:“2019-11-25T19:07:15.059Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.12\u0009Clear Tables from Alpha data\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398572472Z”}
{“log”:“2019-11-25T19:07:15.060Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.13\u0009Free Storagenodes from trash data\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398577901Z”}
{“log”:“2019-11-25T19:07:15.060Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.14\u0009Free Storagenodes from orphaned tmp data\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398583331Z”}
{“log”:“2019-11-25T19:07:15.060Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.15\u0009Start piece_expirations table, deprecate pieceinfo table\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398588694Z”}
{“log”:“2019-11-25T19:07:15.061Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.16\u0009Add reputation and storage usage cache tables\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398594092Z”}
{“log”:“2019-11-25T19:07:15.062Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.17\u0009Create piece_space_used table\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398599575Z”}
{“log”:“2019-11-25T19:07:15.062Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.18\u0009Drop vouchers table\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398604919Z”}
{“log”:“2019-11-25T19:07:15.063Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.19\u0009Add disqualified field to reputation\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.39862594Z”}
{“log”:“2019-11-25T19:07:15.064Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.20\u0009Empty storage_usage table, rename storage_usage.timestamp to interval_start\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.3986358Z”}
{“log”:“2019-11-25T19:07:15.064Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.21\u0009Create satellites table and satellites_exit_progress table\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398641772Z”}
{“log”:“2019-11-25T19:07:15.065Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.22\u0009Vacuum info db\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398646752Z”}
{“log”:“2019-11-25T19:07:15.068Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.23\u0009Split into multiple sqlite databases\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:15.398651608Z”}
{“log”:“2019-11-25T19:07:36.924Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.24\u0009Drop unneeded tables in deprecatedInfoDB\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:36.92505339Z”}
{“log”:“2019-11-25T19:07:38.662Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration.25\u0009Remove address from satellites table\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:38.66291386Z”}
{“log”:“2019-11-25T19:07:38.663Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration\u0009Database Version\u0009{“version”: 25}\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:38.663710522Z”}
{“log”:“2019-11-25T19:07:38.664Z\u0009\u001b[34mINFO\u001b[0m\u0009contact:chore\u0009Storagenode contact chore starting up\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:38.664416915Z”}
{“log”:“2019-11-25T19:07:38.664Z\u0009\u001b[34mINFO\u001b[0m\u0009bandwidth\u0009Performing bandwidth usage rollups\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:38.664442027Z”}
{“log”:“2019-11-25T19:07:38.664Z\u0009\u001b[34mINFO\u001b[0m\u0009Node 1e7SPKFRANfkMB7PHQUbsXLTmNZcvkww9UKExyjHz9V4KCjJsF started\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:38.66488801Z”}
{“log”:“2019-11-25T19:07:38.664Z\u0009\u001b[34mINFO\u001b[0m\u0009Public server started on [::]:28967\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:38.664902932Z”}
{“log”:“2019-11-25T19:07:38.664Z\u0009\u001b[34mINFO\u001b[0m\u0009Private server started on 127.0.0.1:7778\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:38.664909801Z”}
{“log”:“2019-11-25T19:07:38.665Z\u0009\u001b[34mINFO\u001b[0m\u0009piecestore:monitor\u0009Remaining Bandwidth\u0009{“bytes”: 10000000000000000}\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:38.665661086Z”}
{“log”:“2019-11-25T19:07:38.779Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-25T19:07:38.779648011Z”}
{“log”:“2019-11-25T19:22:39.124Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-25T19:22:39.125104917Z”}
{“log”:“2019-11-25T19:37:39.109Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-25T19:37:39.109247032Z”}
{“log”:“2019-11-25T19:52:39.112Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-25T19:52:39.112435294Z”}
{“log”:“2019-11-25T19:55:01.947Z\u0009\u001b[34mINFO\u001b[0m\u0009Got a signal from the OS: “terminated”\n”,“stream”:“stderr”,“time”:“2019-11-25T19:55:01.947694693Z”}
{“log”:“2019-11-25T19:55:33.769Z\u0009\u001b[34mINFO\u001b[0m\u0009Configuration loaded from: /app/config/config.yaml\n”,“stream”:“stderr”,“time”:“2019-11-25T19:55:33.76968786Z”}
{“log”:“2019-11-25T19:55:33.780Z\u0009\u001b[34mINFO\u001b[0m\u0009Operator email: xxxxxxxxxxx\n”,“stream”:“stderr”,“time”:“2019-11-25T19:55:33.780625447Z”}
{“log”:“2019-11-25T19:55:33.780Z\u0009\u001b[34mINFO\u001b[0m\u0009operator wallet:xxxxxxxxxxx\n”,“stream”:“stderr”,“time”:“2019-11-25T19:55:33.780643025Z”}
{“log”:“2019-11-25T19:55:34.912Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-25T19:55:34.912642426Z”}
{“log”:“2019-11-25T19:55:34.919Z\u0009\u001b[34mINFO\u001b[0m\u0009db.migration\u0009Database Version\u0009{“version”: 25}\n”,“stream”:“stderr”,“time”:“2019-11-25T19:55:34.919220175Z”}
{“log”:“2019-11-25T19:55:34.920Z\u0009\u001b[34mINFO\u001b[0m\u0009bandwidth\u0009Performing bandwidth usage rollups\n”,“stream”:“stderr”,“time”:“2019-11-25T19:55:34.9203019Z”}
{“log”:“2019-11-25T19:55:34.920Z\u0009\u001b[34mINFO\u001b[0m\u0009contact:chore\u0009Storagenode contact chore starting up\n”,“stream”:“stderr”,“time”:“2019-11-25T19:55:34.92033377Z”}
{“log”:“2019-11-25T19:55:34.920Z\u0009\u001b[34mINFO\u001b[0m\u0009Node 1e7SPKFRANfkMB7PHQUbsXLTmNZcvkww9UKExyjHz9V4KCjJsF started\n”,“stream”:“stderr”,“time”:“2019-11-25T19:55:34.920349438Z”}
{“log”:“2019-11-25T19:55:34.920Z\u0009\u001b[34mINFO\u001b[0m\u0009Public server started on [::]:28967\n”,“stream”:“stderr”,“time”:“2019-11-25T19:55:34.920366315Z”}
{“log”:“2019-11-25T19:55:34.920Z\u0009\u001b[34mINFO\u001b[0m\u0009Private server started on 127.0.0.1:7778\n”,“stream”:“stderr”,“time”:“2019-11-25T19:55:34.920380798Z”}
{“log”:“2019-11-25T19:55:34.922Z\u0009\u001b[34mINFO\u001b[0m\u0009piecestore:monitor\u0009Remaining Bandwidth\u0009{“bytes”: 10000000000000000}\n”,“stream”:“stderr”,“time”:“2019-11-25T19:55:34.922797851Z”}
{“log”:“2019-11-25T19:55:35.034Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-25T19:55:35.03459504Z”}
{“log”:“2019-11-25T20:10:35.378Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-25T20:10:35.378491498Z”}

What can I do?
Thanks!

2

Ports:

root@Ubuntu-1804 ~ # sudo netstat -plnt
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
tcp 0 0 127.0.0.1:44485 0.0.0.0:* LISTEN 2791/containerd
tcp 0 0 127.0.0.1:14002 0.0.0.0:* LISTEN 18284/docker-proxy
tcp 0 0 127.0.0.53:53 0.0.0.0:* LISTEN 796/systemd-resolve
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 876/sshd
tcp6 0 0 :::28967 :::* LISTEN 18270/docker-proxy
tcp6 0 0 :::22 :::* LISTEN 876/sshd

3

Can you show result of this command ?

docker exec -it storagenode ls -l /app/identity

4

I copied the Identity from another Node which is offline now…isnt that possible?

Will do a new Identity and report the outcome.

5

Got this:

root@Ubuntu-1804 /home/STORJ # docker exec -it storagenode ls -l /app/identity
total 24
-rw-r–r-- 1 root root 546 Nov 26 09:14 ca.1574759584.cert
-rw-r–r-- 1 root root 1076 Nov 26 09:14 ca.cert
-rw------- 1 root root 241 Nov 26 09:14 ca.key
-rw-r–r-- 1 root root 1084 Nov 26 09:14 identity.1574759584.cert
-rw-r–r-- 1 root root 1614 Nov 26 09:14 identity.cert
-rw------- 1 root root 241 Nov 26 09:14 identity.key

My log is full of this:
{“log”:“2019-11-26T05:26:56.661Z\u0009\u001b[34mINFO\u001b[0m\u0009bandwidth\u0009Performing bandwidth usage rollups\n”,“stream”:“stderr”,“time”:“2019-11-26T05:26:56.661475693Z”}
{“log”:“2019-11-26T05:26:57.105Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-26T05:26:57.106112426Z”}
{“log”:“2019-11-26T05:41:57.107Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-26T05:41:57.108091841Z”}
{“log”:“2019-11-26T05:56:57.106Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-26T05:56:57.106501321Z”}
{“log”:“2019-11-26T06:11:57.107Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-26T06:11:57.108081197Z”}
{“log”:“2019-11-26T06:26:56.661Z\u0009\u001b[34mINFO\u001b[0m\u0009bandwidth\u0009Performing bandwidth usage rollups\n”,“stream”:“stderr”,“time”:“2019-11-26T06:26:56.661485082Z”}
{“log”:“2019-11-26T06:26:57.110Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-26T06:26:57.110725461Z”}
{“log”:“2019-11-26T06:41:57.106Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-26T06:41:57.106625816Z”}
{“log”:“2019-11-26T06:56:57.105Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-26T06:56:57.10609442Z”}
{“log”:“2019-11-26T07:11:57.108Z\u0009\u001b[34mINFO\u001b[0m\u0009version\u0009running on version v0.26.2\n”,“stream”:“stderr”,“time”:“2019-11-26T07:11:57.108741763Z”}
{“log”:“2019-11-26T07:26:56.661Z\u0009\u001b[34mINFO\u001b[0m\u0009bandwidth\u0009Performing bandwidth usage rollups\n”,“stream”:“stderr”,“time”:“2019-11-26T07:26:56.661560999Z”}

What can I do?

6

I also got this:

root@Ubuntu-1804 /home/STORJ # sudo netstat -ntlp | grep LISTEN
tcp 0 0 127.0.0.1:44485 0.0.0.0:* LISTEN 2791/containerd
tcp 0 0 127.0.0.1:14002 0.0.0.0:* LISTEN 4540/docker-proxy
tcp 0 0 127.0.0.53:53 0.0.0.0:* LISTEN 796/systemd-resolve
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 876/sshd
tcp6 0 0 :::28967 :::* LISTEN 4526/docker-proxy
tcp6 0 0 :::22 :::* LISTEN 876/sshd
root@Ubuntu-1804 /home/STORJ #

7

Got it. working. Had to deactivate the Hetzner fireball…

8

Awesome. You can always move identity but make sure you copy all files and point it correctly. Also as this is new node its in vetting phase so you get 5% traffic for nearly a month. Good luck!

9

So in the next month I get 100% Treffic if I stay online?

Also if I later on transfer this identity to a new node will I have to start again with those 5%?

10

Nope identity is unique so once its set and used it will have history. If you move your identity you have to move the stored data too.

You won’t get 100% traffic ever just being in beta helps you reach good rep faster and good probability of being chosen :slight_smile: