Sorry for the title, but I’m not sure what’s wrong. Today it stopped working after a reboot.
I searched on Google, checked the logs, and saw that there was a problem with the read database.
I took a backup, deleted the file, and restarted the service, but it didn’t start and rebuild.
It now says “no space left and a long file location”. Please see the log.
Blockquote
server kernel support for server-side tcp fast open remains disabled. {“Process”: “storagenode”}
2026-01-02T17:48:10+01:00 INFO server enable with: sysctl -w net.ipv4.tcp_fastopen=3 {“Process”: “storagenode”}
2026-01-02T17:48:10+01:00 ERROR failure during run {“Process”: “storagenode”, “error”: “Failed to create storage node peer: pieceexpirationstore: mkdir dbs/piece_expirations: no space left on device\n\tstorj.io/storj/storagenode/pieces.NewPieceExpirationStore:85\n\tstorj.io/storj/storagenode.getPieceExpirationStore:1146\n\tstorj.io/storj/storagenode.New:568\n\tmain.cmdRun:84\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.InitBeforeExecute.func1.2:389\n\tstorj.io/common/process.InitBeforeExecute.func1:407\n\tgithub.com/spf13/cobra.(*Command).execute:985\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1117\n\tgithub.com/spf13/cobra.(*Command).Execute:1041\n\tstorj.io/common/process.ExecWithCustomOptions:115\n\tmain.main:34\n\truntime.main:283”, “errorVerbose”: “Failed to create storage node peer: pieceexpirationstore: mkdir dbs/piece_expirations: no space left on device\n\tstorj.io/storj/storagenode/pieces.NewPieceExpirationStore:85\n\tstorj.io/storj/storagenode.getPieceExpirationStore:1146\n\tstorj.io/storj/storagenode.New:568\n\tmain.cmdRun:84\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.InitBeforeExecute.func1.2:389\n\tstorj.io/common/process.InitBeforeExecute.func1:407\n\tgithub.com/spf13/cobra.(*Command).execute:985\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1117\n\tgithub.com/spf13/cobra.(*Command).Execute:1041\n\tstorj.io/common/process.ExecWithCustomOptions:115\n\tmain.main:34\n\truntime.main:283\n\tmain.cmdRun:86\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.InitBeforeExecute.func1.2:389\n\tstorj.io/common/process.InitBeforeExecute.func1:407\n\tgithub.com/spf13/cobra.(*Command).execute:985\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1117\n\tgithub.com/spf13/cobra.(*Command).Execute:1041\n\tstorj.io/common/process.ExecWithCustomOptions:115\n\tmain.main:34\n\truntime.main:283”}
2026-01-02T17:48:10+01:00 FATAL Unrecoverable error {“Process”: “storagenode”, “error”: “Failed to create storage node peer: pieceexpirationstore: mkdir dbs/piece_expirations: no space left on device\n\tstorj.io/storj/storagenode/pieces.NewPieceExpirationStore:85\n\tstorj.io/storj/storagenode.getPieceExpirationStore:1146\n\tstorj.io/storj/storagenode.New:568\n\tmain.cmdRun:84\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.InitBeforeExecute.func1.2:389\n\tstorj.io/common/process.InitBeforeExecute.func1:407\n\tgithub.com/spf13/cobra.(*Command).execute:985\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1117\n\tgithub.com/spf13/cobra.(*Command).Execute:1041\n\tstorj.io/common/process.ExecWithCustomOptions:115\n\tmain.main:34\n\truntime.main:283”, “errorVerbose”: “Failed to create storage node peer: pieceexpirationstore: mkdir dbs/piece_expirations: no space left on device\n\tstorj.io/storj/storagenode/pieces.NewPieceExpirationStore:85\n\tstorj.io/storj/storagenode.getPieceExpirationStore:1146\n\tstorj.io/storj/storagenode.New:568\n\tmain.cmdRun:84\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.InitBeforeExecute.func1.2:389\n\tstorj.io/common/process.InitBeforeExecute.func1:407\n\tgithub.com/spf13/cobra.(*Command).execute:985\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1117\n\tgithub.com/spf13/cobra.(*Command).Execute:1041\n\tstorj.io/common/process.ExecWithCustomOptions:115\n\tmain.main:34\n\truntime.main:283\n\tmain.cmdRun:86\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.InitBeforeExecute.func1.2:389\n\tstorj.io/common/process.InitBeforeExecute.func1:407\n\tgithub.com/spf13/cobra.(*Command).execute:985\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1117\n\tgithub.com/spf13/cobra.(*Command).Execute:1041\n\tstorj.io/common/process.ExecWithCustomOptions:115\n\tmain.main:34\n\truntime.main:283”}
2026-01-02T17:48:23+01:00 INFO Configuration loaded {“Process”: “storagenode”, “Location”: “/app/config/config.yaml”}
2026-01-02T17:48:23+01:00 INFO Anonymized tracing enabled {“Process”: “storagenode”}
2026-01-02T17:48:23+01:00 INFO Operator email {“Process”: “storagenode”, “Address”: “xxx”}
2026-01-02T17:48:23+01:00 INFO Operator wallet {“Process”: “storagenode”, “Address”: “xxx”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “info”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “bandwidth”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “orders”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “piece_expiration”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “pieceinfo”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “piece_spaced_used”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “reputation”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “storage_usage”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “used_serial”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “satellites”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “notifications”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “heldamount”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “pricing”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “secret”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “garbage_collection_filewalker_progress”}
2026-01-02T17:48:23+01:00 INFO db database does not exist {“Process”: “storagenode”, “database”: “used_space_per_prefix”}
2026-01-02T17:48:24+01:00 INFO server kernel support for server-side tcp fast open remains disabled. {“Process”: “storagenode”}
2026-01-02T17:48:24+01:00 INFO server enable with: sysctl -w net.ipv4.tcp_fastopen=3 {“Process”: “storagenode”}
2026-01-02T17:48:24+01:00 ERROR failure during run {“Process”: “storagenode”, “error”: “Failed to create storage node peer: pieceexpirationstore: mkdir dbs/piece_expirations: no space left on device\n\tstorj.io/storj/storagenode/pieces.NewPieceExpirationStore:85\n\tstorj.io/storj/storagenode.getPieceExpirationStore:1146\n\tstorj.io/storj/storagenode.New:568\n\tmain.cmdRun:84\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.InitBeforeExecute.func1.2:389\n\tstorj.io/common/process.InitBeforeExecute.func1:407\n\tgithub.com/spf13/cobra.(*Command).execute:985\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1117\n\tgithub.com/spf13/cobra.(*Command).Execute:1041\n\tstorj.io/common/process.ExecWithCustomOptions:115\n\tmain.main:34\n\truntime.main:283”, “errorVerbose”: “Failed to create storage node peer: pieceexpirationstore: mkdir dbs/piece_expirations: no space left on device\n\tstorj.io/storj/storagenode/pieces.NewPieceExpirationStore:85\n\tstorj.io/storj/storagenode.getPieceExpirationStore:1146\n\tstorj.io/storj/storagenode.New:568\n\tmain.cmdRun:84\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.InitBeforeExecute.func1.2:389\n\tstorj.io/common/process.InitBeforeExecute.func1:407\n\tgithub.com/spf13/cobra.(*Command).execute:985\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1117\n\tgithub.com/spf13/cobra.(*Command).Execute:1041\n\tstorj.io/common/process.ExecWithCustomOptions:115\n\tmain.main:34\n\truntime.main:283\n\tmain.cmdRun:86\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.InitBeforeExecute.func1.2:389\n\tstorj.io/common/process.InitBeforeExecute.func1:407\n\tgithub.com/spf13/cobra.(*Command).execute:985\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1117\n\tgithub.com/spf13/cobra.(*Command).Execute:1041\n\tstorj.io/common/process.ExecWithCustomOptions:115\n\tmain.main:34\n\truntime.main:283”}
2026-01-02T17:48:24+01:00 FATAL Unrecoverable error {“Process”: “storagenode”, “error”: “Failed to create storage node peer: pieceexpirationstore: mkdir dbs/piece_expirations: no space left on device\n\tstorj.io/storj/storagenode/pieces.NewPieceExpirationStore:85\n\tstorj.io/storj/storagenode.getPieceExpirationStore:1146\n\tstorj.io/storj/storagenode.New:568\n\tmain.cmdRun:84\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.InitBeforeExecute.func1.2:389\n\tstorj.io/common/process.InitBeforeExecute.func1:407\n\tgithub.com/spf13/cobra.(*Command).execute:985\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1117\n\tgithub.com/spf13/cobra.(*Command).Execute:1041\n\tstorj.io/common/process.ExecWithCustomOptions:115\n\tmain.main:34\n\truntime.main:283”, “errorVerbose”: “Failed to create storage node peer: pieceexpirationstore: mkdir dbs/piece_expirations: no space left on device\n\tstorj.io/storj/storagenode/pieces.NewPieceExpirationStore:85\n\tstorj.io/storj/storagenode.getPieceExpirationStore:1146\n\tstorj.io/storj/storagenode.New:568\n\tmain.cmdRun:84\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.InitBeforeExecute.func1.2:389\n\tstorj.io/common/process.InitBeforeExecute.func1:407\n\tgithub.com/spf13/cobra.(*Command).execute:985\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1117\n\tgithub.com/spf13/cobra.(*Command).Execute:1041\n\tstorj.io/common/process.ExecWithCustomOptions:115\n\tmain.main:34\n\truntime.main:283\n\tmain.cmdRun:86\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.InitBeforeExecute.func1.2:389\n\tstorj.io/common/process.InitBeforeExecute.func1:407\n\tgithub.com/spf13/cobra.(*Command).execute:985\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1117\n\tgithub.com/spf13/cobra.(*Command).Execute:1041\n\tstorj.io/common/process.ExecWithCustomOptions:115\n\tmain.main:34\n\truntime.main:283”}
the docker use this locations
–mount type=bind,source=“/mnt/user/appdata/storj/Identity/storagenode/”,destination=/app/identity --mount type=bind,source=“/mnt/user/storj/”,destination=/app/config --mount type=bind,source=“/mnt/user/storj-dbs”,destination=/app/dbs --restart unless-stopped
as far as I can see are there meny 100GB free for the database
hope you will take a look
happy new year