Hello,
My node ID 12hMfEBJC2Gp43AELPkMvTa9eP7raNsMV9uahxNwCxt1ff54PU2 stopped working shortly after updating the docker 1.3.3
Unable to restart it and the updates do not work.
I tried another version 1.4 did not work.
My ports 14002 and 28967 are open
I did not receive an email to tell me that my node and offline
Thank you for your help
Where did you find this version ?
What do you mean its not working ? I see its online
Hi
No traffic, no interface, 0 activity with version 1.3.3 for my node since May 4
https://registry.hub.docker.com/r/storjlabs/storagenode/tags?page=1&name=1.4.2
Only follow official ways to update the node unless you want to ruin your node.
Show me last 20 lines of your log.
For the update I download via DOCKER on synology and I create a container with SSH.
More traffic
here is what I could find as a log in docker
| 2020-05-10 06:37:05 | stdout | runtime.main:203 |
|---|---|---|
| 2020-05-10 06:37:05 | stdout | main.main:329 |
| 2020-05-10 06:37:05 | stdout | storj.io/private/process.ExecCustomDebug:68 |
| 2020-05-10 06:37:05 | stdout | storj.io/private/process.ExecWithCustomConfig:86 |
| 2020-05-10 06:37:05 | stdout | github.com/spf13/cobra.(*Command).Execute:885 |
| 2020-05-10 06:37:05 | stdout | github.com/spf13/cobra.(*Command).ExecuteC:945 |
| 2020-05-10 06:37:05 | stdout | github.com/spf13/cobra.(*Command).execute:840 |
| 2020-05-10 06:37:05 | stdout | storj.io/private/process.cleanup.func1:362 |
| 2020-05-10 06:37:05 | stdout | storj.io/private/process.cleanup.func1.4:344 |
| 2020-05-10 06:37:05 | stdout | main.cmdRun:199 |
| 2020-05-10 06:37:05 | stdout | storj.io/storj/storagenode/storagenodedb.(*DB).Preflight:324 |
| 2020-05-10 06:37:05 | stdout | |
| 2020-05-10 06:37:05 | stdout | } |
| 2020-05-10 06:37:05 | stdout | Indexes: nil, |
| 2020-05-10 06:37:05 | stdout | }, |
| 2020-05-10 06:37:05 | stdout | }, |
| 2020-05-10 06:37:05 | stdout | Unique: nil, |
| 2020-05-10 06:37:05 | stdout | PrimaryKey: string{âsatellite_idâ}, |
| 2020-05-10 06:37:05 | stdout | }, |
| 2020-05-10 06:37:05 | stdout | ⌠// 6 identical elements |
| 2020-05-10 06:37:05 | stdout | &{Name: âsuspendedâ, Type: âTIMESTAMPâ, IsNullable: true}, |
| 2020-05-10 06:37:05 | stdout | &{Name: âsatellite_idâ, Type: âBLOBâ}, |
| 2020-05-10 06:37:05 | stdout | + s"Name: joined_at\nType: TIMESTAMP\nNullable: false\nDefault: ââ\nReference: nil", |
| 2020-05-10 06:37:05 | stdout | + s"Name: disqualified\nType: TIMESTAMP\nNullable: true\nDefault: ââ\nReference: nil", |
| 2020-05-10 06:37:05 | stdout | }, |
| 2020-05-10 06:37:05 | stdout | Reference: nil, |
| 2020-05-10 06:37:05 | stdout | Default: ââ, |
| 2020-05-10 06:37:05 | stdout | + IsNullable: false, |
| 2020-05-10 06:37:05 | stdout | - IsNullable: true, |
| 2020-05-10 06:37:05 | stdout | + Type: âREALâ, |
| 2020-05-10 06:37:05 | stdout | - Type: âTIMESTAMPâ, |
| 2020-05-10 06:37:05 | stdout | + Name: âaudit_unknown_reputation_betaâ, |
| 2020-05-10 06:37:05 | stdout | - Name: âjoined_atâ, |
| 2020-05-10 06:37:05 | stdout | &{ |
| 2020-05-10 06:37:05 | stdout | }, |
| 2020-05-10 06:37:05 | stdout | Reference: nil, |
| 2020-05-10 06:37:05 | stdout | Default: ââ, |
| 2020-05-10 06:37:05 | stdout | + IsNullable: false, |
| 2020-05-10 06:37:05 | stdout | - IsNullable: true, |
| 2020-05-10 06:37:05 | stdout | + Type: âREALâ, |
| 2020-05-10 06:37:05 | stdout | - Type: âTIMESTAMPâ, |
| 2020-05-10 06:37:05 | stdout | + Name: âaudit_unknown_reputation_alphaâ, |
| 2020-05-10 06:37:05 | stdout | - Name: âdisqualifiedâ, |
| 2020-05-10 06:37:05 | stdout | &{ |
| 2020-05-10 06:37:05 | stdout | &{Name: âaudit_total_countâ, Type: âINTEGERâ}, |
| 2020-05-10 06:37:05 | stdout | &{Name: âaudit_success_countâ, Type: âINTEGERâ}, |
| 2020-05-10 06:37:05 | stdout | ⌠// 3 identical elements |
| 2020-05-10 06:37:05 | stdout | Columns: *dbschema.Column{ |
| 2020-05-10 06:37:05 | stdout | Name: âreputationâ, |
| 2020-05-10 06:37:05 | stdout | &{ |
| 2020-05-10 06:37:05 | stdout | Tables: *dbschema.Table{ |
| 2020-05-10 06:37:05 | stdout | Error: Error during preflight check for storagenode databases: storage node preflight database error: reputation: expected schema does not match actual: &dbschema.Schema{ |
| 2020-05-10 06:37:04 | stderr | 2020-05-10T06:37:04.004Z INFO db.migration Database Version {âversionâ: 36} |
| 2020-05-10 06:37:03 | stderr | 2020-05-10T06:37:03.236Z INFO Operator wallet {âAddressâ: ââ} |
| 2020-05-10 06:37:03 | stderr | 2020-05-10T06:37:03.235Z INFO Operator email {âAddressâ: ââ} |
| 2020-05-10 06:37:03 | stderr | 2020-05-10T06:37:03.215Z INFO tracing disabled |
| 2020-05-10 06:37:03 | stderr | 2020-05-10T06:37:03.215Z INFO Configuration loaded {âLocationâ: â/app/config/config.yamlâ} |
Can you show result of this command ?
docker logs --tail 20 storagenode
Voici
/$ sudo docker logs --tail 20 storagenode
... // 6 identical elements
},
PrimaryKey: []string{"satellite_id"},
Unique: nil,
},
},
Indexes: nil,
}
storj.io/storj/storagenode/storagenodedb.(*DB).Preflight:324
main.cmdRun:199
storj.io/private/process.cleanup.func1.4:344
storj.io/private/process.cleanup.func1:362
github.com/spf13/cobra.(*Command).execute:840
github.com/spf13/cobra.(*Command).ExecuteC:945
github.com/spf13/cobra.(*Command).Execute:885
storj.io/private/process.ExecWithCustomConfig:86
storj.io/private/process.ExecCustomDebug:68
main.main:329
runtime.main:203This is consequence of update to not published version, which is applied migrations to your databases and rollback to the actual version without rollback of databases.
You now should perform a rollback of migrations for databases.
I would not recommend to forcefully update your node without suggestion to do so.
Please, show the whole errors from your logs, please, take more than 20 lines to have a full error.
Thank you for your reply
How to restore migrations for databases ?
if you want more information tell me how to do it
see more than 20 lines to have a full error with conteneur on synology
âline deleteâ
Please, use the docker logs instead of GUI, I canât compile the whole picture from that tableâŚ
| Information | 2020/04/26 07:45:58 | admin | Add image from docker.io/storjlabs/storagenode:b736d43f-v1.3.3-go1.13.8 |
|---|
docker logs --tail 100 storagenode
Name: "disqualified",
+ Name: "audit_unknown_reputation_alpha",
- Type: "TIMESTAMP",
+ Type: "REAL",
- IsNullable: true,
+ IsNullable: false,
Default: "",
Reference: nil,
},
&{
- Name: "joined_at",
+ Name: "audit_unknown_reputation_beta",
- Type: "TIMESTAMP",
+ Type: "REAL",
- IsNullable: true,
+ IsNullable: false,
Default: "",
Reference: nil,
},
+ s"Name: disqualified\nType: TIMESTAMP\nNullable: true\nDefault: \"\"\nReference: nil",
+ s"Name: joined_at\nType: TIMESTAMP\nNullable: false\nDefault: \"\"\nReference: nil",
&{Name: "satellite_id", Type: "BLOB"},
&{Name: "suspended", Type: "TIMESTAMP", IsNullable: true},
... // 6 identical elements
},
PrimaryKey: []string{"satellite_id"},
Unique: nil,
},
},
Indexes: nil,
}
storj.io/storj/storagenode/storagenodedb.(*DB).Preflight:324
main.cmdRun:199
storj.io/private/process.cleanup.func1.4:344
storj.io/private/process.cleanup.func1:362
github.com/spf13/cobra.(*Command).execute:840
github.com/spf13/cobra.(*Command).ExecuteC:945
github.com/spf13/cobra.(*Command).Execute:885
storj.io/private/process.ExecWithCustomConfig:86
storj.io/private/process.ExecCustomDebug:68
main.main:329
runtime.main:203
2020-05-10T15:08:03.639Z INFO Configuration loaded {"Location": "/app/config/config.yaml"}
2020-05-10T15:08:03.640Z INFO tracing disabled
2020-05-10T15:08:03.660Z INFO Operator email {"Address": "mrbobiuss@hotmail.com"}
2020-05-10T15:08:03.660Z INFO Operator wallet {"Address": "0x7B40fD8E7E3D762B17929cA2fA1B9F6e9F8F5ec7"}
2020-05-10T15:08:04.471Z INFO db.migration Database Version {"version": 36}
Error: Error during preflight check for storagenode databases: storage node preflight database error: reputation: expected schema does not match actual: &dbschema.Schema{
Tables: []*dbschema.Table{
&{
Name: "reputation",
Columns: []*dbschema.Column{
... // 3 identical elements
&{Name: "audit_success_count", Type: "INTEGER"},
&{Name: "audit_total_count", Type: "INTEGER"},
&{
- Name: "disqualified",
+ Name: "audit_unknown_reputation_alpha",
- Type: "TIMESTAMP",
+ Type: "REAL",
- IsNullable: true,
+ IsNullable: false,
Default: "",
Reference: nil,
},
&{
- Name: "joined_at",
+ Name: "audit_unknown_reputation_beta",
- Type: "TIMESTAMP",
+ Type: "REAL",
- IsNullable: true,
+ IsNullable: false,
Default: "",
Reference: nil,
},
+ s"Name: disqualified\nType: TIMESTAMP\nNullable: true\nDefault: \"\"\nReference: nil",
+ s"Name: joined_at\nType: TIMESTAMP\nNullable: false\nDefault: \"\"\nReference: nil",
&{Name: "satellite_id", Type: "BLOB"},
&{Name: "suspended", Type: "TIMESTAMP", IsNullable: true},
... // 6 identical elements
},
PrimaryKey: []string{"satellite_id"},
Unique: nil,
},
},
Indexes: nil,
}
storj.io/storj/storagenode/storagenodedb.(*DB).Preflight:324
main.cmdRun:199
storj.io/private/process.cleanup.func1.4:344
storj.io/private/process.cleanup.func1:362
github.com/spf13/cobra.(*Command).execute:840
github.com/spf13/cobra.(*Command).ExecuteC:945
github.com/spf13/cobra.(*Command).Execute:885
storj.io/private/process.ExecWithCustomConfig:86
storj.io/private/process.ExecCustomDebug:68
main.main:329
runtime.main:203
reputation.db
/path/to/ to the right path to that database (/storage/ in a docker version from the article above):sqlite3 /path/to/reputation.db
ALTER TABLE reputation RENAME TO reputation_new;
CREATE TABLE reputation (
satellite_id BLOB NOT NULL,
uptime_success_count INTEGER NOT NULL,
uptime_total_count INTEGER NOT NULL,
uptime_reputation_alpha REAL NOT NULL,
uptime_reputation_beta REAL NOT NULL,
uptime_reputation_score REAL NOT NULL,
audit_success_count INTEGER NOT NULL,
audit_total_count INTEGER NOT NULL,
audit_reputation_alpha REAL NOT NULL,
audit_reputation_beta REAL NOT NULL,
audit_reputation_score REAL NOT NULL,
disqualified TIMESTAMP,
updated_at TIMESTAMP NOT NULL, suspended TIMESTAMP, joined_at TIMESTAMP,
PRIMARY KEY (satellite_id)
);
PRAGMA foreign_keys=off;
BEGIN TRANSACTION;
INSERT INTO reputation (satellite_id,
uptime_success_count,
uptime_total_count,
uptime_reputation_alpha,
uptime_reputation_beta,
uptime_reputation_score,
audit_success_count,
audit_total_count,
audit_reputation_alpha,
audit_reputation_beta,
audit_reputation_score,
disqualified,
updated_at,
suspended)
SELECT satellite_id,
uptime_success_count,
uptime_total_count,
uptime_reputation_alpha,
uptime_reputation_beta,
uptime_reputation_score,
audit_success_count,
audit_total_count,
audit_reputation_alpha,
audit_reputation_beta,
audit_reputation_score,
disqualified,
updated_at,
suspended
FROM reputation_new;
DROP TABLE reputation_new;
COMMIT;
PRAGMA foreign_keys=on;
.exit
I applied the procedure here ==> https://support.storj.io/hc/en-us/articles/360029309111-How-to-fix-a-database-disk-image-is-malformed-
I have relaunched my container, here is the report below.
Storj does not work / Can you help me ?
admin@SYNOLOGY_4K : / $ sudo docker logs --tail 20 storagenode
2020-05-15T18:53:36.899Z INFO Configuration loaded from: /app/config/config.yaml
2020-05-15T18:53:36.920Z INFO Operator email: xxxxxxxxxxxx@hotmail.com
2020-05-15T18:53:36.920Z INFO operator wallet: 0x7B40fD8E7E3D1221212122B17929cA2fA1B9F6e9F8F5ec7
2020-05-15T18:53:37.732Z INFO version running on version v1.2.1
2020-05-15T18:53:37.749Z INFO db.migration Database Version {âversionâ: 33}
Error: Error during preflight check for storagenode databases: storage node preflight database error: reputation: schema check failed: file is not a database
storj.io/storj/storagenode/storagenodedb.(*DB).Preflight:295
main.cmdRun:199
storj.io/private/process.cleanup.func1.2:312
storj.io/private/process.cleanup.func1:330
github.com/spf13/cobra.(*Command).execute:840
github.com/spf13/cobra.(*Command).ExecuteC:945
github.com/spf13/cobra.(*Command).Execute:885
storj.io/private/process.ExecWithCustomConfig:84
storj.io/private/process.ExecCustomDebug:66
main.main:329
runtime.main:203
2020-05-15T18:54:39.938Z INFO Configuration loaded from: /app/config/config.yaml
2020-05-15T18:54:39.960Z INFO Operator email: xxxxxxxxx@hotmail.com
2020-05-15T18:54:39.960Z INFO operator wallet: 0x7B40fD8nhnhnhnhnhnh2B17929cA2fA1B9F6e9F8F5ec7
Now the reputation.db is lost.
reputation.db
sqlite3 reputation.db
CREATE TABLE reputation (
satellite_id BLOB NOT NULL,
uptime_success_count INTEGER NOT NULL,
uptime_total_count INTEGER NOT NULL,
uptime_reputation_alpha REAL NOT NULL,
uptime_reputation_beta REAL NOT NULL,
uptime_reputation_score REAL NOT NULL,
audit_success_count INTEGER NOT NULL,
audit_total_count INTEGER NOT NULL,
audit_reputation_alpha REAL NOT NULL,
audit_reputation_beta REAL NOT NULL,
audit_reputation_score REAL NOT NULL,
disqualified TIMESTAMP,
updated_at TIMESTAMP NOT NULL, suspended TIMESTAMP, joined_at TIMESTAMP,
PRIMARY KEY (satellite_id)
);
CREATE TABLE versions (version int, commited_at text);
.exit
check the result
admin@SYNOLOGY_4K : / $ sudo docker logs --tail 20 storagenode
2020-05-23T06:49:55.978Z INFO Operator email {âAddressâ: âxxxxxxxxx@hotmail.comâ}
2020-05-23T06:49:55.978Z INFO Operator wallet {âAddressâ: â0x7B40f45
rfD8E7E3brfsrD762B17929cA2DdDfA1B9F6e9F8F5ec7â}
2020-05-23T06:49:56.781Z INFO db.migration.34 Add suspended field to satellites db
Error: Error creating tables for master database on storagenode: migrate: no such table: reputation
storj.io/storj/private/migrate.SQL.Run:252
storj.io/storj/private/migrate.(*Migration).Run.func1:171
storj.io/storj/private/dbutil/txutil.withTxOnce:75
storj.io/storj/private/dbutil/txutil.WithTx:36
storj.io/storj/private/migrate.(*Migration).Run:170
storj.io/storj/storagenode/storagenodedb.(*DB).MigrateToLatest:294
main.cmdRun:180
storj.io/private/process.cleanup.func1.4:343
storj.io/private/process.cleanup.func1:361
github.com/spf13/cobra.(*Command).execute:840
github.com/spf13/cobra.(*Command).ExecuteC:945
github.com/spf13/cobra.(*Command).Execute:885
storj.io/private/process.ExecWithCustomConfig:86
storj.io/private/process.ExecCustomDebug:68
main.main:320
runtime.main:203
Seems you didnât specified path to the reputation.db. It should point to the reputation.db in your storage location.
The path is depend on your method of running a sqlite3 to correct the issue.
If it was a docker, you should mount a path to the storage to the docker container with sqlite3, for example, I will assume that your storage located in the /mnt/storagenode/storage, then the command would look like:
docker stop -t 300 storagenode
docker rm storagenode
reputation.db
rm /mnt/storagenode/storage/reputation.db
docker run -it --rm --mount type=bind,source=/mnt/storagenode/storage,destination=/data sstc/sqlite3 sqlite3 reputation.db
CREATE TABLE reputation (
satellite_id BLOB NOT NULL,
uptime_success_count INTEGER NOT NULL,
uptime_total_count INTEGER NOT NULL,
uptime_reputation_alpha REAL NOT NULL,
uptime_reputation_beta REAL NOT NULL,
uptime_reputation_score REAL NOT NULL,
audit_success_count INTEGER NOT NULL,
audit_total_count INTEGER NOT NULL,
audit_reputation_alpha REAL NOT NULL,
audit_reputation_beta REAL NOT NULL,
audit_reputation_score REAL NOT NULL,
disqualified TIMESTAMP,
updated_at TIMESTAMP NOT NULL, suspended TIMESTAMP, joined_at TIMESTAMP,
PRIMARY KEY (satellite_id)
);
CREATE TABLE versions (version int, commited_at text);
.exit
thank you for answer
3- i run this command
admin@SYNOLOGY_4K:/$ sudo docker run -it --rm --mount type=bind,source=/volume1/STORJ/DATA1/storage,destination=/data sstc/sqlite3 sqlite3 reputation.db
audit_reputation_score REAL NOT NULL,
disqualified TIMESTAMP,
updated_at TIMESTAMP NOT NULL, suspended TIMESTAMP, joined_at TIMESTAMP,
PRIMARY KEY (satellite_id)
);
CREATE TABLE versions (version int, commited_at text);
.exit
CREATE TABLE reputation (
satellite_id BLOB NOT NULL,
uptime_success_count INTEGER NOT NULL,
uptime_total_count INTEGER NOT NULL,
uptime_reputation_alpha REAL NOT NULL,
uptime_reputation_beta REAL NOT NULL,
uptime_reputation_score REAL NOT NULL,
audit_success_count INTEGER NOT NULL,
audit_total_count INTEGER NOT NULL,
audit_reputation_alpha REAL NOT NULL,
audit_reputation_beta REAL NOT NULL,
audit_reputation_score REAL NOT NULL,
disqualified TIMESTAMP,
updated_at TIMESTAMP NOT NULL, suspended TIMESTAMP, joined_at TIMESTAMP,
PRIMARY KEY (satellite_id)
);
CREATE TABLE versions (version int, commited_at text);
.exit
SQLite version 3.30.1 2019-10-10 20:19:45
Enter â.helpâ for usage hints.
sqlite> CREATE TABLE reputation (
LL,âŚ> satellite_id BLOB NOT NUL
EGER NOT NULL, uptime_success_count INTE
ER NOT NULL, uptime_total_count INTEGE
REAL NOT NULL, uptime_reputation_alpha R
EAL NOT NULL, uptime_reputation_beta RE
REAL NOT NULL, uptime_reputation_score R
GER NOT NULL, audit_success_count INTEG
R NOT NULL, audit_total_count INTEGER
EAL NOT NULL, audit_reputation_alpha RE
AL NOT NULL, audit_reputation_beta REA
EAL NOT NULL, audit_reputation_score RE
âŚ> disqualified TIMESTAMP,
NULL, suspended TIMESTAMP, joined_at TIMESTAMP, updated_at TIMESTAMP NOT
d) âŚ> PRIMARY KEY (satellite_id
âŚ> );
sqlite> CREATE TABLE versions (version int, commited_at text);
sqlite> .exit
4- I have an error with my node which seems to be disqualified
5- I check your logs after install my parameters of my node
admin@SYNOLOGY_4K : / $ sudo docker logs --tail 30 storagenode
storj.io/private/process.ExecWithCustomConfig:86
storj.io/private/process.ExecCustomDebug:68
main.main:320
runtime.main:203
2020-05-23T18:25:31.325Z INFO Configuration loaded {âLocationâ: â/app/config/config.yamlâ}
2020-05-23T18:25:31.326Z INFO tracing disabled
2020-05-23T18:25:31.346Z INFO Operator email {âAddressâ: âmrbobiuss@hotmail.comâ}
2020-05-23T18:25:31.346Z INFO Operator wallet {âAddressâ: âxxxxxxxxxxxxxâ}
2020-05-23T18:25:32.220Z INFO db.migration.34 Add suspended field to satellites db
Error: Error creating tables for master database on storagenode: migrate: duplicate column name: suspended
storj.io/storj/private/migrate.SQL.Run:252
storj.io/storj/private/migrate.(*Migration).Run.func1:171
storj.io/storj/private/dbutil/txutil.withTxOnce:75
storj.io/storj/private/dbutil/txutil.WithTx:36
storj.io/storj/private/migrate.(*Migration).Run:170
storj.io/storj/storagenode/storagenodedb.(*DB).MigrateToLatest:294
main.cmdRun:180
storj.io/private/process.cleanup.func1.4:343
storj.io/private/process.cleanup.func1:361
github.com/spf13/cobra.(*Command).execute:840
github.com/spf13/cobra.(*Command).ExecuteC:945
github.com/spf13/cobra.(*Command).Execute:885
storj.io/private/process.ExecWithCustomConfig:86
storj.io/private/process.ExecCustomDebug:68
main.main:320
runtime.main:203
2020-05-23T18:26:34.713Z INFO Configuration loaded {âLocationâ: â/app/config/config.yamlâ}
2020-05-23T18:26:34.714Z INFO tracing disabled
2020-05-23T18:26:34.734Z INFO Operator email {âAddressâ: âxxxxxxxxxx@hotmail.comâ}
2020-05-23T18:26:34.734Z INFO Operator wallet {âAddressâ: âxxxxxxxxxxxxxxxxxxxâ}
55/5000
Do you have a solution to help me restart my node
Thank you for you help.
Cdt
Christophe
Why you think it is disqualified? Did you lost the data? If not, then we can continue to fix the database
sudo docker run -it --rm --mount type=bind,source=/volume1/STORJ/DATA1/storage,destination=/data sstc/sqlite3 sqlite3 reputation.db
drop table reputation;
CREATE TABLE reputation (
satellite_id BLOB NOT NULL,
uptime_success_count INTEGER NOT NULL,
uptime_total_count INTEGER NOT NULL,
uptime_reputation_alpha REAL NOT NULL,
uptime_reputation_beta REAL NOT NULL,
uptime_reputation_score REAL NOT NULL,
audit_success_count INTEGER NOT NULL,
audit_total_count INTEGER NOT NULL,
audit_reputation_alpha REAL NOT NULL,
audit_reputation_beta REAL NOT NULL,
audit_reputation_score REAL NOT NULL,
disqualified TIMESTAMP,
updated_at TIMESTAMP NOT NULL,
joined_at TIMESTAMP,
PRIMARY KEY (satellite_id)
);
.exit