Container on QNAP keeps stopping

Node Operators troubleshooting
, ,
1

Hi there,

I have configured the STORJ on a QNAP NAS via CLI, but the container keeps stopping. Here is what I get on the console:

2023-04-27 21:25:28,310 INFO exited: storagenode (exit status 1; not expected)
2023-04-27 21:25:28,310 INFO gave up: storagenode entered FATAL state, too many start retries too quickly
2023-04-27 21:25:28,311 WARN received SIGQUIT indicating exit request
2023-04-27 21:25:28,311 INFO waiting for processes-exit-eventlistener to die
2023-04-27 21:25:30,314 INFO stopped: processes-exit-eventlistener (terminated by SIGTERM)

Could someone assist me here? Why is this container stopped and not staying on “Running” state?

With kind regards,
Angelos Pitsos

1 Like
2

Only 5 log lines? Need more. The ERROR or FATAL was probably logged earlier. Roughly 50 lines should be enough or find when it’s reading config file and get everything from that point till the end.

3

I have this exact problem. Tried setting up my node today but absolutely can’t understand what’s wrong with it. Also getting 5 log lines.

4

Hi @mars_9t,

I hope this will help…

2023-04-27 22:58:21,017 INFO Set uid to user 0 succeeded
2023-04-27 22:58:21,043 INFO RPC interface 'supervisor' initialized
2023-04-27 22:58:21,044 INFO supervisord started with pid 1
2023-04-27 22:58:22,048 INFO spawned: 'processes-exit-eventlistener' with pid 39
2023-04-27 22:58:22,052 INFO spawned: 'storagenode' with pid 40
2023-04-27 22:58:22,139 INFO spawned: 'storagenode-updater' with pid 41
2023-04-27T22:58:22.289Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.caller"}
2023-04-27T22:58:22.289Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.encoding"}
2023-04-27T22:58:22.289Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.output"}
2023-04-27T22:58:22.289Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.stack"}
2023-04-27T22:58:22.289Z        INFO    Anonymized tracing enabled      {"Process": "storagenode-updater"}
2023-04-27T22:58:22.292Z        FATAL   Error loading identity. {"Process": "storagenode-updater", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:108\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:20\n\truntime.main:250"}
2023-04-27 22:58:22,295 INFO exited: storagenode-updater (exit status 1; not expected)
2023-04-27T22:58:22.315Z        INFO    Anonymized tracing enabled      {"Process": "storagenode"}
2023-04-27T22:58:22.322Z        ERROR   Failed to load identity.        {"Process": "storagenode", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:182\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:478\n\truntime.main:250"}
Error: Failed to load identity: file or directory not found: open identity/identity.cert: no such file or directory
        storj.io/common/identity.Config.Load:326
        main.cmdRun:182
        storj.io/private/process.cleanup.func1.4:377
        storj.io/private/process.cleanup.func1:395
        github.com/spf13/cobra.(*Command).execute:852
        github.com/spf13/cobra.(*Command).ExecuteC:960
        github.com/spf13/cobra.(*Command).Execute:897
        storj.io/private/process.ExecWithCustomConfigAndLogger:92
        main.main:478
        runtime.main:250
2023-04-27 22:58:22,329 INFO exited: storagenode (exit status 1; not expected)
2023-04-27 22:58:23,335 INFO success: processes-exit-eventlistener entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-04-27 22:58:23,338 INFO spawned: 'storagenode' with pid 53
2023-04-27 22:58:23,344 INFO spawned: 'storagenode-updater' with pid 54
2023-04-27T22:58:23.374Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.level"}
2023-04-27T22:58:23.375Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.output"}
2023-04-27T22:58:23.375Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.stack"}
2023-04-27T22:58:23.376Z        INFO    Anonymized tracing enabled      {"Process": "storagenode-updater"}
2023-04-27T22:58:23.378Z        FATAL   Error loading identity. {"Process": "storagenode-updater", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:108\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:20\n\truntime.main:250"}
2023-04-27 22:58:23,381 INFO exited: storagenode-updater (exit status 1; not expected)
2023-04-27T22:58:23.445Z        INFO    Anonymized tracing enabled      {"Process": "storagenode"}
2023-04-27T22:58:23.446Z        ERROR   Failed to load identity.        {"Process": "storagenode", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:182\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:478\n\truntime.main:250"}
Error: Failed to load identity: file or directory not found: open identity/identity.cert: no such file or directory
        storj.io/common/identity.Config.Load:326
        main.cmdRun:182
        storj.io/private/process.cleanup.func1.4:377
        storj.io/private/process.cleanup.func1:395
        github.com/spf13/cobra.(*Command).execute:852
        github.com/spf13/cobra.(*Command).ExecuteC:960
        github.com/spf13/cobra.(*Command).Execute:897
        storj.io/private/process.ExecWithCustomConfigAndLogger:92
        main.main:478
        runtime.main:250
2023-04-27 22:58:23,450 INFO exited: storagenode (exit status 1; not expected)
2023-04-27 22:58:25,455 INFO spawned: 'storagenode' with pid 65
2023-04-27 22:58:25,459 INFO spawned: 'storagenode-updater' with pid 66
2023-04-27T22:58:25.565Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.caller"}
2023-04-27T22:58:25.566Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.development"}
2023-04-27T22:58:25.566Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.encoding"}
2023-04-27T22:58:25.567Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.level"}
2023-04-27T22:58:25.567Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.output"}
2023-04-27T22:58:25.567Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.stack"}
2023-04-27T22:58:25.568Z        INFO    Anonymized tracing enabled      {"Process": "storagenode-updater"}
2023-04-27T22:58:25.573Z        FATAL   Error loading identity. {"Process": "storagenode-updater", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:108\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:20\n\truntime.main:250"}
2023-04-27 22:58:25,576 INFO exited: storagenode-updater (exit status 1; not expected)
2023-04-27T22:58:25.648Z        INFO    Anonymized tracing enabled      {"Process": "storagenode"}
2023-04-27T22:58:25.649Z        ERROR   Failed to load identity.        {"Process": "storagenode", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:182\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:478\n\truntime.main:250"}
Error: Failed to load identity: file or directory not found: open identity/identity.cert: no such file or directory
        storj.io/common/identity.Config.Load:326
        main.cmdRun:182
        storj.io/private/process.cleanup.func1.4:377
        storj.io/private/process.cleanup.func1:395
        github.com/spf13/cobra.(*Command).execute:852
        github.com/spf13/cobra.(*Command).ExecuteC:960
        github.com/spf13/cobra.(*Command).Execute:897
        storj.io/private/process.ExecWithCustomConfigAndLogger:92
        main.main:478
        runtime.main:250
2023-04-27 22:58:25,653 INFO exited: storagenode (exit status 1; not expected)
2023-04-27 22:58:28,659 INFO spawned: 'storagenode' with pid 78
2023-04-27 22:58:28,663 INFO spawned: 'storagenode-updater' with pid 79
2023-04-27T22:58:28.789Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.output"}
2023-04-27T22:58:28.789Z        INFO    Anonymized tracing enabled      {"Process": "storagenode-updater"}
2023-04-27T22:58:28.790Z        FATAL   Error loading identity. {"Process": "storagenode-updater", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:108\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:20\n\truntime.main:250"}
2023-04-27 22:58:28,793 INFO exited: storagenode-updater (exit status 1; not expected)
2023-04-27T22:58:28.832Z        INFO    Anonymized tracing enabled      {"Process": "storagenode"}
2023-04-27 22:58:28,833 INFO gave up: storagenode-updater entered FATAL state, too many start retries too quickly
2023-04-27T22:58:28.834Z        ERROR   Failed to load identity.        {"Process": "storagenode", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:182\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:478\n\truntime.main:250"}
Error: Failed to load identity: file or directory not found: open identity/identity.cert: no such file or directory
        storj.io/common/identity.Config.Load:326
        main.cmdRun:182
        storj.io/private/process.cleanup.func1.4:377
        storj.io/private/process.cleanup.func1:395
        github.com/spf13/cobra.(*Command).execute:852
        github.com/spf13/cobra.(*Command).ExecuteC:960
        github.com/spf13/cobra.(*Command).Execute:897
        storj.io/private/process.ExecWithCustomConfigAndLogger:92
        main.main:478
        runtime.main:250
2023-04-27 22:58:28,836 WARN received SIGQUIT indicating exit request
2023-04-27 22:58:28,836 INFO waiting for storagenode, processes-exit-eventlistener to die
2023-04-27 22:58:28,838 INFO exited: storagenode (exit status 1; not expected)
2023-04-27 22:58:29,840 INFO stopped: processes-exit-eventlistener (terminated by SIGTERM)
2023-04-27 22:58:54,006 INFO Set uid to user 0 succeeded
2023-04-27 22:58:54,030 INFO RPC interface 'supervisor' initialized
2023-04-27 22:58:54,033 INFO supervisord started with pid 1
2023-04-27 22:58:55,036 INFO spawned: 'processes-exit-eventlistener' with pid 11
2023-04-27 22:58:55,047 INFO spawned: 'storagenode' with pid 12
2023-04-27 22:58:55,064 INFO spawned: 'storagenode-updater' with pid 13
2023-04-27T22:58:55.123Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.encoding"}
2023-04-27T22:58:55.126Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.level"}
2023-04-27T22:58:55.128Z        INFO    Anonymized tracing enabled      {"Process": "storagenode-updater"}
2023-04-27T22:58:55.135Z        FATAL   Error loading identity. {"Process": "storagenode-updater", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:108\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:20\n\truntime.main:250"}
2023-04-27 22:58:55,141 INFO exited: storagenode-updater (exit status 1; not expected)
2023-04-27T22:58:55.442Z        INFO    Anonymized tracing enabled      {"Process": "storagenode"}
2023-04-27T22:58:55.444Z        ERROR   Failed to load identity.        {"Process": "storagenode", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:182\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:478\n\truntime.main:250"}
Error: Failed to load identity: file or directory not found: open identity/identity.cert: no such file or directory
        storj.io/common/identity.Config.Load:326
        main.cmdRun:182
        storj.io/private/process.cleanup.func1.4:377
        storj.io/private/process.cleanup.func1:395
        github.com/spf13/cobra.(*Command).execute:852
        github.com/spf13/cobra.(*Command).ExecuteC:960
        github.com/spf13/cobra.(*Command).Execute:897
        storj.io/private/process.ExecWithCustomConfigAndLogger:92
        main.main:478
        runtime.main:250
2023-04-27 22:58:55,451 INFO exited: storagenode (exit status 1; not expected)
2023-04-27 22:58:56,453 INFO success: processes-exit-eventlistener entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-04-27 22:58:56,456 INFO spawned: 'storagenode' with pid 25
2023-04-27 22:58:56,460 INFO spawned: 'storagenode-updater' with pid 26
2023-04-27T22:58:56.567Z        INFO    Anonymized tracing enabled      {"Process": "storagenode-updater"}
2023-04-27T22:58:56.568Z        FATAL   Error loading identity. {"Process": "storagenode-updater", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:108\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:20\n\truntime.main:250"}
2023-04-27 22:58:56,574 INFO exited: storagenode-updater (exit status 1; not expected)
2023-04-27T22:58:56.641Z        INFO    Anonymized tracing enabled      {"Process": "storagenode"}
2023-04-27T22:58:56.645Z        ERROR   Failed to load identity.        {"Process": "storagenode", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:182\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:478\n\truntime.main:250"}
Error: Failed to load identity: file or directory not found: open identity/identity.cert: no such file or directory
        storj.io/common/identity.Config.Load:326
        main.cmdRun:182
        storj.io/private/process.cleanup.func1.4:377
        storj.io/private/process.cleanup.func1:395
        github.com/spf13/cobra.(*Command).execute:852
        github.com/spf13/cobra.(*Command).ExecuteC:960
        github.com/spf13/cobra.(*Command).Execute:897
        storj.io/private/process.ExecWithCustomConfigAndLogger:92
        main.main:478
        runtime.main:250
2023-04-27 22:58:56,653 INFO exited: storagenode (exit status 1; not expected)
2023-04-27 22:58:58,658 INFO spawned: 'storagenode' with pid 40
2023-04-27 22:58:58,664 INFO spawned: 'storagenode-updater' with pid 41
2023-04-27T22:58:58.766Z        INFO    Anonymized tracing enabled      {"Process": "storagenode-updater"}
2023-04-27T22:58:58.771Z        FATAL   Error loading identity. {"Process": "storagenode-updater", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:108\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:20\n\truntime.main:250"}
2023-04-27 22:58:58,775 INFO exited: storagenode-updater (exit status 1; not expected)
2023-04-27T22:58:58.837Z        INFO    Anonymized tracing enabled      {"Process": "storagenode"}
2023-04-27T22:58:58.840Z        ERROR   Failed to load identity.        {"Process": "storagenode", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:182\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:478\n\truntime.main:250"}
Error: Failed to load identity: file or directory not found: open identity/identity.cert: no such file or directory
        storj.io/common/identity.Config.Load:326
        main.cmdRun:182
        storj.io/private/process.cleanup.func1.4:377
        storj.io/private/process.cleanup.func1:395
        github.com/spf13/cobra.(*Command).execute:852
        github.com/spf13/cobra.(*Command).ExecuteC:960
        github.com/spf13/cobra.(*Command).Execute:897
        storj.io/private/process.ExecWithCustomConfigAndLogger:92
        main.main:478
        runtime.main:250
2023-04-27 22:58:58,851 INFO exited: storagenode (exit status 1; not expected)
2023-04-27 22:59:01,859 INFO spawned: 'storagenode' with pid 52
2023-04-27 22:59:01,865 INFO spawned: 'storagenode-updater' with pid 53
2023-04-27T22:59:02.041Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.output"}
2023-04-27T22:59:02.049Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.encoding"}
2023-04-27T22:59:02.063Z        INFO    Anonymized tracing enabled      {"Process": "storagenode-updater"}
2023-04-27T22:59:02.067Z        FATAL   Error loading identity. {"Process": "storagenode-updater", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:108\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:20\n\truntime.main:250"}
2023-04-27 22:59:02,078 INFO exited: storagenode-updater (exit status 1; not expected)
2023-04-27T22:59:02.302Z        INFO    Anonymized tracing enabled      {"Process": "storagenode"}
2023-04-27 22:59:02,310 INFO gave up: storagenode-updater entered FATAL state, too many start retries too quickly
2023-04-27T22:59:02.321Z        ERROR   Failed to load identity.        {"Process": "storagenode", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:182\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:478\n\truntime.main:250"}
Error: Failed to load identity: file or directory not found: open identity/identity.cert: no such file or directory
        storj.io/common/identity.Config.Load:326
        main.cmdRun:182
        storj.io/private/process.cleanup.func1.4:377
        storj.io/private/process.cleanup.func1:395
        github.com/spf13/cobra.(*Command).execute:852
        github.com/spf13/cobra.(*Command).ExecuteC:960
        github.com/spf13/cobra.(*Command).Execute:897
        storj.io/private/process.ExecWithCustomConfigAndLogger:92
        main.main:478
        runtime.main:250
2023-04-27 22:59:02,327 WARN received SIGQUIT indicating exit request
2023-04-27 22:59:02,332 INFO waiting for storagenode, processes-exit-eventlistener to die
2023-04-27 22:59:02,353 INFO stopped: storagenode (exit status 1)
2023-04-27 22:59:02,361 INFO stopped: processes-exit-eventlistener (terminated by SIGTERM)
5

Your identity is not correct. Check the identity folder as there should be 6 files present. If there are only 4 then you need to authorise it - Step 5. Create an Identity - Storj Docs

6

Hi @Stob,

The identity is authorized and they are 6 files. I followed the procedure with success.

Something else should be the problem.

7

If it’s authorised correctly then the files must be in the wrong folder/directory as the node can’t find them.

8

Hi @Stob,

I think I have some progress. The owner of the files wasn’t the “admin”, but another user I have created while setting up the NAS. I changed the ownership of the files in the directory “identity” and that problem solved.

But the container keeps stopping again. I am placing here the logs in case you can understand why and maybe being able to help.

Thanks a lot in advance for your help and your support!

2023-04-27 23:35:52,407 WARN received SIGQUIT indicating exit request
2023-04-27 23:35:52,408 INFO waiting for storagenode, processes-exit-eventlistener to die
2023-04-27 23:35:52,417 INFO stopped: storagenode (exit status 1)
2023-04-27 23:35:52,420 INFO stopped: processes-exit-eventlistener (terminated by SIGTERM)
2023-04-27 23:36:32,365 INFO Set uid to user 0 succeeded
2023-04-27 23:36:32,397 INFO RPC interface 'supervisor' initialized
2023-04-27 23:36:32,408 INFO supervisord started with pid 1
2023-04-27 23:36:33,415 INFO spawned: 'processes-exit-eventlistener' with pid 11
2023-04-27 23:36:33,426 INFO spawned: 'storagenode' with pid 12
2023-04-27 23:36:33,449 INFO spawned: 'storagenode-updater' with pid 13
2023-04-27T23:36:33.565Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.caller"}
2023-04-27T23:36:33.565Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.output"}
2023-04-27T23:36:33.565Z        INFO    Anonymized tracing enabled      {"Process": "storagenode-updater"}
2023-04-27T23:36:33.576Z        FATAL   Error loading identity. {"Process": "storagenode-updater", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:108\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:20\n\truntime.main:250"}
2023-04-27 23:36:33,579 INFO exited: storagenode-updater (exit status 1; not expected)
2023-04-27T23:36:33.661Z        INFO    Anonymized tracing enabled      {"Process": "storagenode"}
2023-04-27T23:36:33.664Z        ERROR   Failed to load identity.        {"Process": "storagenode", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:182\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:478\n\truntime.main:250"}
Error: Failed to load identity: file or directory not found: open identity/identity.cert: no such file or directory
        storj.io/common/identity.Config.Load:326
        main.cmdRun:182
        storj.io/private/process.cleanup.func1.4:377
        storj.io/private/process.cleanup.func1:395
        github.com/spf13/cobra.(*Command).execute:852
        github.com/spf13/cobra.(*Command).ExecuteC:960
        github.com/spf13/cobra.(*Command).Execute:897
        storj.io/private/process.ExecWithCustomConfigAndLogger:92
        main.main:478
        runtime.main:250
2023-04-27 23:36:33,668 INFO exited: storagenode (exit status 1; not expected)
2023-04-27 23:36:34,672 INFO success: processes-exit-eventlistener entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-04-27 23:36:34,675 INFO spawned: 'storagenode' with pid 25
2023-04-27 23:36:34,684 INFO spawned: 'storagenode-updater' with pid 26
2023-04-27T23:36:34.854Z        INFO    Anonymized tracing enabled      {"Process": "storagenode"}
2023-04-27T23:36:34.858Z        ERROR   Failed to load identity.        {"Process": "storagenode", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:182\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:478\n\truntime.main:250"}
Error: Failed to load identity: file or directory not found: open identity/identity.cert: no such file or directory
        storj.io/common/identity.Config.Load:326
        main.cmdRun:182
        storj.io/private/process.cleanup.func1.4:377
        storj.io/private/process.cleanup.func1:395
        github.com/spf13/cobra.(*Command).execute:852
        github.com/spf13/cobra.(*Command).ExecuteC:960
        github.com/spf13/cobra.(*Command).Execute:897
        storj.io/private/process.ExecWithCustomConfigAndLogger:92
        main.main:478
        runtime.main:250
2023-04-27 23:36:34,865 INFO exited: storagenode (exit status 1; not expected)
2023-04-27T23:36:34.878Z        INFO    Anonymized tracing enabled      {"Process": "storagenode-updater"}
2023-04-27T23:36:34.883Z        FATAL   Error loading identity. {"Process": "storagenode-updater", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:108\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:20\n\truntime.main:250"}
2023-04-27 23:36:34,890 INFO exited: storagenode-updater (exit status 1; not expected)
2023-04-27 23:36:36,895 INFO spawned: 'storagenode' with pid 38
2023-04-27 23:36:36,902 INFO spawned: 'storagenode-updater' with pid 39
2023-04-27T23:36:37.025Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.output"}
2023-04-27T23:36:37.029Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.development"}
2023-04-27T23:36:37.030Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.encoding"}
2023-04-27T23:36:37.035Z        INFO    Anonymized tracing enabled      {"Process": "storagenode-updater"}
2023-04-27T23:36:37.040Z        FATAL   Error loading identity. {"Process": "storagenode-updater", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:108\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:20\n\truntime.main:250"}
2023-04-27 23:36:37,045 INFO exited: storagenode-updater (exit status 1; not expected)
2023-04-27T23:36:37.070Z        INFO    Anonymized tracing enabled      {"Process": "storagenode"}
2023-04-27T23:36:37.075Z        ERROR   Failed to load identity.        {"Process": "storagenode", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:182\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:478\n\truntime.main:250"}
Error: Failed to load identity: file or directory not found: open identity/identity.cert: no such file or directory
        storj.io/common/identity.Config.Load:326
        main.cmdRun:182
        storj.io/private/process.cleanup.func1.4:377
        storj.io/private/process.cleanup.func1:395
        github.com/spf13/cobra.(*Command).execute:852
        github.com/spf13/cobra.(*Command).ExecuteC:960
        github.com/spf13/cobra.(*Command).Execute:897
        storj.io/private/process.ExecWithCustomConfigAndLogger:92
        main.main:478
        runtime.main:250
2023-04-27 23:36:37,082 INFO exited: storagenode (exit status 1; not expected)
2023-04-27 23:36:40,088 INFO spawned: 'storagenode' with pid 52
2023-04-27 23:36:40,099 INFO spawned: 'storagenode-updater' with pid 53
2023-04-27T23:36:40.185Z        INFO    Invalid configuration file value for key        {"Process": "storagenode-updater", "Key": "log.development"}
2023-04-27T23:36:40.187Z        INFO    Anonymized tracing enabled      {"Process": "storagenode-updater"}
2023-04-27T23:36:40.192Z        FATAL   Error loading identity. {"Process": "storagenode-updater", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:108\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:20\n\truntime.main:250"}
2023-04-27 23:36:40,196 INFO exited: storagenode-updater (exit status 1; not expected)
2023-04-27T23:36:40.254Z        INFO    Anonymized tracing enabled      {"Process": "storagenode"}
2023-04-27 23:36:40,257 INFO gave up: storagenode-updater entered FATAL state, too many start retries too quickly
2023-04-27T23:36:40.259Z        ERROR   Failed to load identity.        {"Process": "storagenode", "error": "file or directory not found: open identity/identity.cert: no such file or directory", "errorVerbose": "file or directory not found: open identity/identity.cert: no such file or directory\n\tstorj.io/common/identity.Config.Load:326\n\tmain.cmdRun:182\n\tstorj.io/private/process.cleanup.func1.4:377\n\tstorj.io/private/process.cleanup.func1:395\n\tgithub.com/spf13/cobra.(*Command).execute:852\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:960\n\tgithub.com/spf13/cobra.(*Command).Execute:897\n\tstorj.io/private/process.ExecWithCustomConfigAndLogger:92\n\tmain.main:478\n\truntime.main:250"}
2023-04-27 23:36:40,264 WARN received SIGQUIT indicating exit request
2023-04-27 23:36:40,266 INFO waiting for storagenode, processes-exit-eventlistener to die
Error: Failed to load identity: file or directory not found: open identity/identity.cert: no such file or directory
        storj.io/common/identity.Config.Load:326
        main.cmdRun:182
        storj.io/private/process.cleanup.func1.4:377
        storj.io/private/process.cleanup.func1:395
        github.com/spf13/cobra.(*Command).execute:852
        github.com/spf13/cobra.(*Command).ExecuteC:960
        github.com/spf13/cobra.(*Command).Execute:897
        storj.io/private/process.ExecWithCustomConfigAndLogger:92
        main.main:478
        runtime.main:250
2023-04-27 23:36:40,275 INFO stopped: storagenode (exit status 1)
2023-04-27 23:36:40,279 INFO stopped: processes-exit-eventlistener (terminated by SIGTERM)
9

HI again,

I think I solved the problem completely. I had to amend the path from:

/share/CACHEDEV1_DATA/STORJ/

into

/share/STORJ/

for both the “data” and the “identity” directories.

Secondly, I realized that if I go in the settings of the container and enable the toggle “Auto start”, this is causing also problems and restarts.

Now, not only it works and is stable, but it also exhanges data and I also can see the Dashboard at https://IP-of-the-NAS:14002, which I couldn’t reach it before!

I’d like to thank you for all the efforts and the support.

With kind regards,
Angelos Pitsos

2 Likes
10

I believe you don’t need to set anything in container settings. All the setup and run commands must be run in cli and they can have all the settings that you need, including autorestart. You can use the GUI interface for log monithoring.