Error: Error starting master database on storagenode: database: disk I/O error: input/output error

Node Operators troubleshooting
1

Hi. I meet a problem on my new node. It worked perfectly about 48h before crashing. Now, my SN can’t help restarting.
Thank you in advance for your help.

2 
Here are my logs:
$sudo docker logs --tail 40 storagenode
Error: Error starting master database on storagenode: database: disk I/O error: input/output error
	storj.io/storj/storagenode/storagenodedb.(*DB).openDatabase:323
	storj.io/storj/storagenode/storagenodedb.(*DB).openExistingDatabase:305
	storj.io/storj/storagenode/storagenodedb.(*DB).openDatabases:281
	storj.io/storj/storagenode/storagenodedb.OpenExisting:248
	main.cmdRun:160
	storj.io/private/process.cleanup.func1.4:363
	storj.io/private/process.cleanup.func1:381
	github.com/spf13/cobra.(*Command).execute:842
	github.com/spf13/cobra.(*Command).ExecuteC:950
	github.com/spf13/cobra.(*Command).Execute:887
	storj.io/private/process.ExecWithCustomConfig:88
	storj.io/private/process.ExecCustomDebug:70
	main.main:385
	runtime.main:204
2021-02-19T23:34:46.561Z	INFO	Configuration loaded	{"Location": "/app/config/config.yaml"}
2021-02-19T23:34:46.574Z	INFO	Operator email	{"Address": "xxxx"}
2021-02-19T23:34:46.575Z	INFO	Operator wallet	{"Address": "xxxx"}
3

Looks like your disk failed? Are you able to browse the disk at all?

4

Hello @noshin,
Welcome to the forum!

Please, check your disk for errors ASAP

5

Hello, you’re right. My disk became unmounted and crashed my system.
I umounted it and i am verifying bad blocks. I’ll keep informed.
Thank you both of you for your help.

6

bad news, the test is still pending and I have lots of bad blocks… I think I’ll have to replace it…

7

I changed my disk and restarted the node. Everything seems to be ok now.
Thank you for your help.

1 Like