Unrecoverable error {"error": "Error creating tables for master database on storagenode:

Since this morning after storagenode restart I get this error and I can not run anymore my node:

Unrecoverable error {“error”: “Error creating tables for master database on storagenode: migrate: creating version table failed: migrate: file is not a database\n\tstorj.io/storj/internal/migrate.(*Migration).Run:112\n\tstorj.io/storj/storagenode/storagenodedb.(*DB).CreateTables:222\n\tmain.cmdRun:167\n\tstorj.io/storj/pkg/process.cleanup.func1.2:264\n\tstorj.io/storj/pkg/process.cleanup.func1:282\n\tgithub.com/spf13/cobra.(*Command).execute:762\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:852\n\tgithub.com/spf13/cobra.(*Command).Execute:800\n\tstorj.io/storj/pkg/process.Exec:73\n\tmain.main:296\n\truntime.main:203”, “errorVerbose”: “Error creating tables for master database on storagenode: migrate: creating version table failed: migrate: file is not a database\n\tstorj.io/storj/internal/migrate.(*Migration).Run:112\n\tstorj.io/storj/storagenode/storagenodedb.(*DB).CreateTables:222\n\tmain.cmdRun:167\n\tstorj.io/storj/pkg/process.cleanup.func1.2:264\n\tstorj.io/storj/pkg/process.cleanup.func1:282\n\tgithub.com/spf13/cobra.(*Command).execute:762\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:852\n\tgithub.com/spf13/cobra.(*Command).Execute:800\n\tstorj.io/storj/pkg/process.Exec:73\n\tmain.main:296\n\truntime.main:203\n\tmain.cmdRun:169\n\tstorj.io/storj/pkg/process.cleanup.func1.2:264\n\tstorj.io/storj/pkg/process.cleanup.func1:282\n\tgithub.com/spf13/cobra.(*Command).execute:762\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:852\n\tgithub.com/spf13/cobra.(*Command).Execute:800\n\tstorj.io/storj/pkg/process.Exec:73\n\tmain.main:296\n\truntime.main:203”}

Seems your info.db got corrupted. Try this

https://storjlabs.atlassian.net/wiki/spaces/SCKB/pages/104235043/How+to+fix+a+database+disk+image+is+malformed

I have try this method but doesn’t work, on the first command I get:

Error: file is not a database
failed to resize tty, using default size

At this point, the only option is to delete the info.db and start the node. It will loose the stat about usage and some unsent orders and could fail audits. This is because the node will not know anything about the asked piece, because the metadata is lost. Also, you can not run the node if free space is less than 500GB

I have try to delete info.db but doesn’t start and I get this error:

2019-09-24T07:30:04.542499788Z 2019-09-24T07:30:04.542Z INFO Configuration loaded from: /app/config/config.yaml

2019-09-24T07:30:04.573874340Z 2019-09-24T07:30:04.573Z INFO Operator email: brizio71@gmail.com

2019-09-24T07:30:04.573929240Z 2019-09-24T07:30:04.573Z INFO operator wallet: 0xB8f8a2A65916b1442B824833Cfd6101910f8Ab7b

2019-09-24T07:30:06.254500428Z 2019-09-24T07:30:06.254Z INFO version running on version v0.21.1

2019-09-24T07:30:06.261682896Z 2019-09-24T07:30:06.261Z INFO db.migration Database Version {“version”: 21}

2019-09-24T07:30:06.264786468Z 2019-09-24T07:30:06.261Z INFO contact:chore Storagenode contact chore starting up

2019-09-24T07:30:06.264849276Z 2019-09-24T07:30:06.262Z INFO piecestore:monitor Remaining Bandwidth {“bytes”: 650000000000000}

2019-09-24T07:30:06.264868860Z 2019-09-24T07:30:06.263Z INFO Node 12hpvUSVRDAhujRZAq1fSjq2woz2sh3Gns9vYP7f56ukypCVYAN started

2019-09-24T07:30:06.264885336Z 2019-09-24T07:30:06.263Z INFO Public server started on [::]:28967

2019-09-24T07:30:06.264901368Z 2019-09-24T07:30:06.263Z INFO Private server started on 127.0.0.1:7778

2019-09-24T07:30:06.264917676Z 2019-09-24T07:30:06.263Z INFO bandwidth Performing bandwidth usage rollups

2019-09-24T07:30:06.375552264Z panic: page 21 already freed

2019-09-24T07:30:06.375602532Z

2019-09-24T07:30:06.375619908Z goroutine 209 [running]:

2019-09-24T07:30:06.375635232Z github.com/boltdb/bolt.(*freelist).free(0xc0003b2c30, 0x99c3a7, 0x7fb97ffbc000)

2019-09-24T07:30:06.375664044Z /go/pkg/mod/github.com/boltdb/bolt@v1.3.1/freelist.go:121 +0x2a0

2019-09-24T07:30:06.375682164Z github.com/boltdb/bolt.(*node).spill(0xc00019d2d0, 0xc0003fffa0, 0x1)

2019-09-24T07:30:06.375698100Z /go/pkg/mod/github.com/boltdb/bolt@v1.3.1/node.go:363 +0x206

2019-09-24T07:30:06.375713340Z github.com/boltdb/bolt.(*node).spill(0xc00019d260, 0xc0003fff80, 0x1)

2019-09-24T07:30:06.375728424Z /go/pkg/mod/github.com/boltdb/bolt@v1.3.1/node.go:350 +0xba

2019-09-24T07:30:06.375801444Z github.com/boltdb/bolt.(*node).spill(0xc00019d1f0, 0xc0001c98c0, 0xc00035da20)

2019-09-24T07:30:06.375818076Z /go/pkg/mod/github.com/boltdb/bolt@v1.3.1/node.go:350 +0xba

2019-09-24T07:30:06.375833412Z github.com/boltdb/bolt.(*Bucket).spill(0xc0001eb4c0, 0xc0001c9800, 0xc00035dc18)

2019-09-24T07:30:06.375848640Z /go/pkg/mod/github.com/boltdb/bolt@v1.3.1/bucket.go:570 +0x473

2019-09-24T07:30:06.375864312Z github.com/boltdb/bolt.(*Bucket).spill(0xc0003d6a98, 0x70eba511, 0x18e9940)

2019-09-24T07:30:06.375879060Z /go/pkg/mod/github.com/boltdb/bolt@v1.3.1/bucket.go:537 +0x3d5

2019-09-24T07:30:06.375893976Z github.com/boltdb/bolt.(*Tx).Commit(0xc0003d6a80, 0x0, 0x0)

2019-09-24T07:30:06.375908856Z /go/pkg/mod/github.com/boltdb/bolt@v1.3.1/tx.go:163 +0xf2

2019-09-24T07:30:06.375923844Z github.com/boltdb/bolt.(*DB).Update(0xc0003f4000, 0xc00035deb8, 0x0, 0x0)

2019-09-24T07:30:06.375938424Z /go/pkg/mod/github.com/boltdb/bolt@v1.3.1/db.go:605 +0x106

2019-09-24T07:30:06.375953700Z github.com/boltdb/bolt.(*batch).run(0xc0001eb480)

2019-09-24T07:30:06.375968496Z /go/pkg/mod/github.com/boltdb/bolt@v1.3.1/db.go:717 +0x11c

2019-09-24T07:30:06.375983484Z sync.(*Once).doSlow(0xc0001eb490, 0xc00018a7a8)

2019-09-24T07:30:06.375998004Z /usr/local/go/src/sync/once.go:66 +0xe3

2019-09-24T07:30:06.376012404Z sync.(*Once).Do(…)

2019-09-24T07:30:06.376026684Z /usr/local/go/src/sync/once.go:57

2019-09-24T07:30:06.376041228Z github.com/boltdb/bolt.(*batch).trigger(0xc0001eb480)

2019-09-24T07:30:06.376055856Z /go/pkg/mod/github.com/boltdb/bolt@v1.3.1/db.go:699 +0x65

2019-09-24T07:30:06.376070796Z created by time.goFunc

2019-09-24T07:30:06.376085052Z /usr/local/go/src/time/sleep.go:168 +0x44

@Alexey any ideas on this one?

I have solved deleting the file kademlia !

1 Like