System clock is out of sync after reboot

Node Operators troubleshooting
,
21

after running 114 version you will not be able to run lower version like 113 112 because of different versions of databases, may be just if to remove db…

22

I have tried to remove databases and change to 113.4 version, not working. But I easily run it from Docker. Looks nodes need to be reinstalled. Why Storj did such raw update and publish it…

23

i just tried one node/ removed db and run 112 and it works…

24

with 113.4 what errror? the same like 114?

25

Yes, it was same. After node reinstallation with db removal it works. Indicated version is 113.2

26

why not 113.4? maybe we should to update nodes continously?

27

Have no idea. There are no option to choose

28

why did you select 113.2 not 113.4. 113.4 doesnt work?

29

There is an option to select versions?

30

yes

31

Well nobody more didnt try to upgrade to 114 version? tried continously 112,113,114 but the same error on 114

32

1.114 is not released version. I would suggest to do not upgrade ahead of https://version.storj.io/

Also, I believe, that production satellites will reject Dev (*-rc) versions. Please, install the 1.113.2

33

update to todays released version on win 1.114.2 also broke my node , im also using ntp tool so its not time issue , everything was working just fine with previous 1.113.4 ver.

2024-09-30T20:54:55+03:00 INFO db.migration migrate/versions.go:221 Database Version {“version”: 62}
2024-09-30T20:54:55+03:00 INFO preflight:localtime preflight/localtime.go:54 start checking local system clock with trusted satellites’ system clock.
2024-09-30T20:54:55+03:00 ERROR storagenode/peer.go:1010 Failed preflight check. {“error”: “system clock is out of sync: system clock is out of sync with all trusted satellites”, “errorVerbose”: “system clock is out of sync: system clock is out of sync with all trusted satellites\n\tstorj.io/storj/storagenode/preflight.(*LocalTime).Check:96\n\tstorj.io/storj/storagenode.(*Peer).Run:1009\n\tmain.cmdRun:125\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.cleanup.func1.4:392\n\tstorj.io/common/process.cleanup.func1:410\n\tgithub.com/spf13/cobra.(*Command).execute:983\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1115\n\tgithub.com/spf13/cobra.(*Command).Execute:1039\n\tstorj.io/common/process.ExecWithCustomOptions:112\n\tstorj.io/common/process.ExecWithCustomConfigAndLogger:77\n\tstorj.io/common/process.ExecWithCustomConfig:72\n\tstorj.io/common/process.Exec:62\n\tmain.(*service).Execute.func1:107\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78”}

1 Like
34

If you are sure your clock and time zone is correct try adding --privileged flag to the run command.

Maybe you have similar issue like here, but error message is suppressed Storagenode stopped working on Pi4 - ERROR: The certificate of 'version.storj.io' is not trusted - #4 by arrogantrabbit

35

checked , no such flag for windows version at least i cant find it in listed ones

36

It’s a Docker thing. If you use Docker, you can find it in Docker help.

37

The current version is 1.113.2 accordingly https://version.storj.io
Please do not upgrade to not released versions on production nodes.
You may use them for QA satellite though:

38

Полностью аналогичная ситуация на версии v1.114.0 и v1.114.2 прошлые версии работают корректно. OS Windows Server 2022

2024-10-01T11:17:55+07:00 INFO db.migration migrate/versions.go:221 Database Version {“version”: 62}
2024-10-01T11:17:55+07:00 INFO preflight:localtime preflight/localtime.go:54 start checking local system clock with trusted satellites’ system clock.
2024-10-01T11:17:55+07:00 ERROR storagenode/peer.go:1010 Failed preflight check. {“error”: “system clock is out of sync: system clock is out of sync with all trusted satellites”, “errorVerbose”: “system clock is out of sync: system clock is out of sync with all trusted satellites\n\tstorj.io/storj/storagenode/preflight.(*LocalTime).Check:96\n\tstorj.io/storj/storagenode.(*Peer).Run:1009\n\tmain.cmdRun:125\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.cleanup.func1.4:392\n\tstorj.io/common/process.cleanup.func1:410\n\tgithub.com/spf13/cobra.(*Command).execute:983\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1115\n\tgithub.com/spf13/cobra.(*Command).Execute:1039\n\tstorj.io/common/process.ExecWithCustomOptions:112\n\tstorj.io/common/process.ExecWithCustomConfigAndLogger:77\n\tstorj.io/common/process.ExecWithCustomConfig:72\n\tstorj.io/common/process.Exec:62\n\tmain.(*service).Execute.func1:107\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78”}
storj.io/storj/storagenode.(*Peer).Run
/go/src/storj.io/storj/storagenode/peer.go:1010
main.cmdRun
/go/src/storj.io/storj/cmd/storagenode/cmd_run.go:125
main.newRunCmd.func1
/go/src/storj.io/storj/cmd/storagenode/cmd_run.go:33
storj.io/common/process.cleanup.func1.4
/go/pkg/mod/storj.io/common@v0.0.0-20240913104706-8fd6fa0286a3/process/exec_conf.go:392
storj.io/common/process.cleanup.func1
/go/pkg/mod/storj.io/common@v0.0.0-20240913104706-8fd6fa0286a3/process/exec_conf.go:410
github.com/spf13/cobra.(*Command).execute
/go/pkg/mod/github.com/spf13/cobra@v1.8.0/command.go:983
github.com/spf13/cobra.(*Command).ExecuteC
/go/pkg/mod/github.com/spf13/cobra@v1.8.0/command.go:1115
github.com/spf13/cobra.(*Command).Execute
/go/pkg/mod/github.com/spf13/cobra@v1.8.0/command.go:1039
storj.io/common/process.ExecWithCustomOptions
/go/pkg/mod/storj.io/common@v0.0.0-20240913104706-8fd6fa0286a3/process/exec_conf.go:112
storj.io/common/process.ExecWithCustomConfigAndLogger
/go/pkg/mod/storj.io/common@v0.0.0-20240913104706-8fd6fa0286a3/process/exec_conf.go:77
storj.io/common/process.ExecWithCustomConfig
/go/pkg/mod/storj.io/common@v0.0.0-20240913104706-8fd6fa0286a3/process/exec_conf.go:72
storj.io/common/process.Exec
/go/pkg/mod/storj.io/common@v0.0.0-20240913104706-8fd6fa0286a3/process/exec_conf.go:62
main.(*service).Execute.func1
/go/src/storj.io/storj/cmd/storagenode/service_windows.go:107
The Go Programming Language
/go/pkg/mod/golang.org/x/sync@v0.8.0/errgroup/errgroup.go:78
2024-10-01T11:17:55+07:00 ERROR storagenode/cmd_run.go:50 failure during run {“error”: “system clock is out of sync: system clock is out of sync with all trusted satellites”, “errorVerbose”: “system clock is out of sync: system clock is out of sync with all trusted satellites\n\tstorj.io/storj/storagenode/preflight.(*LocalTime).Check:96\n\tstorj.io/storj/storagenode.(*Peer).Run:1009\n\tmain.cmdRun:125\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.cleanup.func1.4:392\n\tstorj.io/common/process.cleanup.func1:410\n\tgithub.com/spf13/cobra.(*Command).execute:983\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1115\n\tgithub.com/spf13/cobra.(*Command).Execute:1039\n\tstorj.io/common/process.ExecWithCustomOptions:112\n\tstorj.io/common/process.ExecWithCustomConfigAndLogger:77\n\tstorj.io/common/process.ExecWithCustomConfig:72\n\tstorj.io/common/process.Exec:62\n\tmain.(*service).Execute.func1:107\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78”}
main.cmdRun.func1
/go/src/storj.io/storj/cmd/storagenode/cmd_run.go:50
main.cmdRun
/go/src/storj.io/storj/cmd/storagenode/cmd_run.go:128
main.newRunCmd.func1
/go/src/storj.io/storj/cmd/storagenode/cmd_run.go:33
storj.io/common/process.cleanup.func1.4
/go/pkg/mod/storj.io/common@v0.0.0-20240913104706-8fd6fa0286a3/process/exec_conf.go:392
storj.io/common/process.cleanup.func1
/go/pkg/mod/storj.io/common@v0.0.0-20240913104706-8fd6fa0286a3/process/exec_conf.go:410
github.com/spf13/cobra.(*Command).execute
/go/pkg/mod/github.com/spf13/cobra@v1.8.0/command.go:983
github.com/spf13/cobra.(*Command).ExecuteC
/go/pkg/mod/github.com/spf13/cobra@v1.8.0/command.go:1115
github.com/spf13/cobra.(*Command).Execute
/go/pkg/mod/github.com/spf13/cobra@v1.8.0/command.go:1039
storj.io/common/process.ExecWithCustomOptions
/go/pkg/mod/storj.io/common@v0.0.0-20240913104706-8fd6fa0286a3/process/exec_conf.go:112
storj.io/common/process.ExecWithCustomConfigAndLogger
/go/pkg/mod/storj.io/common@v0.0.0-20240913104706-8fd6fa0286a3/process/exec_conf.go:77
storj.io/common/process.ExecWithCustomConfig
/go/pkg/mod/storj.io/common@v0.0.0-20240913104706-8fd6fa0286a3/process/exec_conf.go:72
storj.io/common/process.Exec
/go/pkg/mod/storj.io/common@v0.0.0-20240913104706-8fd6fa0286a3/process/exec_conf.go:62
main.(*service).Execute.func1
/go/src/storj.io/storj/cmd/storagenode/service_windows.go:107
The Go Programming Language
/go/pkg/mod/golang.org/x/sync@v0.8.0/errgroup/errgroup.go:78
2024-10-01T11:17:55+07:00 FATAL process/exec_conf.go:428 Unrecoverable error {“error”: “system clock is out of sync: system clock is out of sync with all trusted satellites”, “errorVerbose”: “system clock is out of sync: system clock is out of sync with all trusted satellites\n\tstorj.io/storj/storagenode/preflight.(*LocalTime).Check:96\n\tstorj.io/storj/storagenode.(*Peer).Run:1009\n\tmain.cmdRun:125\n\tmain.newRunCmd.func1:33\n\tstorj.io/common/process.cleanup.func1.4:392\n\tstorj.io/common/process.cleanup.func1:410\n\tgithub.com/spf13/cobra.(*Command).execute:983\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:1115\n\tgithub.com/spf13/cobra.(*Command).Execute:1039\n\tstorj.io/common/process.ExecWithCustomOptions:112\n\tstorj.io/common/process.ExecWithCustomConfigAndLogger:77\n\tstorj.io/common/process.ExecWithCustomConfig:72\n\tstorj.io/common/process.Exec:62\n\tmain.(*service).Execute.func1:107\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:78”}

39

Production satellites likely will reject nodes with newer version than the satellite code.
Please use the recommended version from https://version.storj.io

на русском

Production спутники скорее всего не будут принимать узлы с более новыми версиями, чем их код.
Пожалуйста, используйте рекомендованные версии в https://version.storj.io

40

@Vasabi @Aka985 @bmr
Could you please try to uncomment this option in the config.yaml file: