Recently I had problems with my node. If we look back from the start it was running fine without any problems 2-3 months straight, eversince a full server restart it have lived its own life
In the beginning it worked to just reinstall the node, but that dont work anymore.
I have check all standard settings over and over again and it look as it should be looking.
This is my log over the night, it was working yesterday.
2020-02-10T00:01:32.604+0100 INFO bandwidth Performing bandwidth usage rollups
2020-02-10T00:01:33.467+0100 INFO version running on version v0.31.12
2020-02-10T00:16:33.347+0100 INFO version running on version v0.31.12
2020-02-10T00:31:33.379+0100 INFO version running on version v0.31.12
2020-02-10T00:41:11.309+0100 INFO Interrogate request received.
2020-02-10T00:46:33.579+0100 INFO version running on version v0.31.12
2020-02-10T01:01:32.603+0100 INFO bandwidth Performing bandwidth usage rollups
2020-02-10T01:01:33.371+0100 INFO version running on version v0.31.12
2020-02-10T01:16:33.473+0100 INFO version running on version v0.31.12
2020-02-10T01:31:33.377+0100 INFO version running on version v0.31.12
2020-02-10T01:41:10.957+0100 INFO Interrogate request received.
2020-02-10T01:46:33.336+0100 INFO version running on version v0.31.12
2020-02-10T02:01:32.603+0100 INFO bandwidth Performing bandwidth usage rollups
2020-02-10T02:01:33.340+0100 INFO version running on version v0.31.12
2020-02-10T02:16:33.322+0100 INFO version running on version v0.31.12
2020-02-10T02:31:33.473+0100 INFO version running on version v0.31.12
2020-02-10T02:41:11.529+0100 INFO Interrogate request received.
2020-02-10T02:46:33.389+0100 INFO version running on version v0.31.12
2020-02-10T03:01:32.603+0100 INFO bandwidth Performing bandwidth usage rollups
2020-02-10T03:01:33.333+0100 INFO version running on version v0.31.12
2020-02-10T03:16:33.371+0100 INFO version running on version v0.31.12
2020-02-10T03:28:25.723+0100 INFO trust Scheduling next refresh {“after”: “4h52m32.357650914s”}
2020-02-10T03:31:33.320+0100 INFO version running on version v0.31.12
2020-02-10T03:41:11.149+0100 INFO Interrogate request received.
2020-02-10T03:46:33.454+0100 INFO version running on version v0.31.12
2020-02-10T04:01:32.603+0100 INFO bandwidth Performing bandwidth usage rollups
2020-02-10T04:01:33.344+0100 INFO version running on version v0.31.12
2020-02-10T04:16:33.339+0100 INFO version running on version v0.31.12
2020-02-10T04:31:33.339+0100 INFO version running on version v0.31.12
2020-02-10T04:41:10.739+0100 INFO Interrogate request received.
2020-02-10T04:46:33.326+0100 INFO version running on version v0.31.12
2020-02-10T05:01:32.603+0100 INFO bandwidth Performing bandwidth usage rollups
2020-02-10T05:01:33.463+0100 INFO version running on version v0.31.12
2020-02-10T05:09:15.034+0100 INFO Stop/Shutdown request received.
2020-02-10T05:09:17.165+0100 INFO Configuration loaded from: C:\Program Files\Storj\Storage Node\config.yaml
2020-02-10T05:09:18.315+0100 INFO version running on version v0.31.12
2020-02-10T05:09:18.342+0100 INFO db.migration Database Version {“version”: 31}
2020-02-10T05:09:19.325+0100 INFO preflight:localtime start checking local system clock with trusted satellites’ system clock.
2020-02-10T05:09:20.295+0100 INFO preflight:localtime local system clock is in sync with trusted satellites’ system clock.
2020-02-10T05:09:20.295+0100 INFO bandwidth Performing bandwidth usage rollups
2020-02-10T05:09:20.296+0100 INFO trust Scheduling next refresh {“after”: “5h38m5.18353752s”}
2020-02-10T05:09:20.298+0100 INFO Node started
2020-02-10T05:09:20.298+0100 INFO Public server started on [::]:28967
2020-02-10T05:09:20.325+0100 INFO piecestore:monitor Remaining Bandwidth {“bytes”: 31827290874368}
2020-02-10T05:09:20.447+0100 INFO version running on version v0.31.12
2020-02-10T05:09:57.302+0100 INFO Stop/Shutdown request received.
2020-02-10T05:11:53.885+0100 INFO Configuration loaded from: C:\Program Files\Storj\Storage Node\config.yaml
2020-02-10T05:11:55.547+0100 ERROR version Failed to do periodic version check: version control client error: Get https://version.storj.io: dial tcp: lookup version.storj.io: no such host
2020-02-10T05:11:55.711+0100 INFO db.migration Database Version {“version”: 31}
2020-02-10T05:11:56.269+0100 WARN trust Failed to fetch URLs from source; used cache {“source”: “https://tardigrade.io/trusted-satellites”, “error”: “HTTP source: Get https://tardigrade.io/trusted-satellites: dial tcp: lookup tardigrade.io: no such host”, “errorVerbose”: “HTTP source: Get https://tardigrade.io/trusted-satellites: dial tcp: lookup tardigrade.io: no such host\n\tstorj.io/storj/storagenode/trust.(*HTTPSource).FetchEntries:63\n\tstorj.io/storj/storagenode/trust.(*List).fetchEntries:90\n\tstorj.io/storj/storagenode/trust.(*List).FetchURLs:49\n\tstorj.io/storj/storagenode/trust.(*Pool).fetchURLs:240\n\tstorj.io/storj/storagenode/trust.(*Pool).Refresh:177\n\tstorj.io/storj/storagenode.(*Peer).Run:485\n\tmain.cmdRun:206\n\tstorj.io/storj/pkg/process.cleanup.func1.2:299\n\tstorj.io/storj/pkg/process.cleanup.func1:317\n\tgithub.com/spf13/cobra.(*Command).execute:826\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:914\n\tgithub.com/spf13/cobra.(*Command).Execute:864\n\tstorj.io/storj/pkg/process.ExecWithCustomConfig:79\n\tstorj.io/storj/pkg/process.Exec:61\n\tmain.(*service).Execute.func1:66\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-02-10T05:11:56.273+0100 INFO preflight:localtime start checking local system clock with trusted satellites’ system clock.
2020-02-10T05:11:56.274+0100 ERROR preflight:localtime unable to get satellite system time {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “error”: “rpccompat: dial tcp: lookup europe-west-1.tardigrade.io: no such host”, “errorVerbose”: “rpccompat: dial tcp: lookup europe-west-1.tardigrade.io: no such host\n\tstorj.io/common/rpc.Dialer.dialTransport:242\n\tstorj.io/common/rpc.Dialer.dial:219\n\tstorj.io/common/rpc.Dialer.DialAddressID:138\n\tstorj.io/storj/storagenode/preflight.(*LocalTime).getSatelliteTime:110\n\tstorj.io/storj/storagenode/preflight.(*LocalTime).Check.func1:67\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-02-10T05:11:56.274+0100 ERROR preflight:localtime unable to get satellite system time {“Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “error”: “rpccompat: dial tcp: lookup asia-east-1.tardigrade.io: no such host”, “errorVerbose”: “rpccompat: dial tcp: lookup asia-east-1.tardigrade.io: no such host\n\tstorj.io/common/rpc.Dialer.dialTransport:242\n\tstorj.io/common/rpc.Dialer.dial:219\n\tstorj.io/common/rpc.Dialer.DialAddressID:138\n\tstorj.io/storj/storagenode/preflight.(*LocalTime).getSatelliteTime:110\n\tstorj.io/storj/storagenode/preflight.(*LocalTime).Check.func1:67\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-02-10T05:11:56.274+0100 ERROR preflight:localtime unable to get satellite system time {“Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “error”: “rpccompat: dial tcp: lookup us-central-1.tardigrade.io: no such host”, “errorVerbose”: “rpccompat: dial tcp: lookup us-central-1.tardigrade.io: no such host\n\tstorj.io/common/rpc.Dialer.dialTransport:242\n\tstorj.io/common/rpc.Dialer.dial:219\n\tstorj.io/common/rpc.Dialer.DialAddressID:138\n\tstorj.io/storj/storagenode/preflight.(*LocalTime).getSatelliteTime:110\n\tstorj.io/storj/storagenode/preflight.(*LocalTime).Check.func1:67\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-02-10T05:11:56.274+0100 ERROR preflight:localtime unable to get satellite system time {“Satellite ID”: “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”, “error”: “rpccompat: dial tcp: lookup satellite.stefan-benten.de: no such host”, “errorVerbose”: “rpccompat: dial tcp: lookup satellite.stefan-benten.de: no such host\n\tstorj.io/common/rpc.Dialer.dialTransport:242\n\tstorj.io/common/rpc.Dialer.dial:219\n\tstorj.io/common/rpc.Dialer.DialAddressID:138\n\tstorj.io/storj/storagenode/preflight.(*LocalTime).getSatelliteTime:110\n\tstorj.io/storj/storagenode/preflight.(*LocalTime).Check.func1:67\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-02-10T05:11:56.274+0100 FATAL failed preflight check {“error”: “system clock is out of sync: system clock is out of sync with all trusted satellites”, “errorVerbose”: “system clock is out of sync: system clock is out of sync with all trusted satellites\n\tstorj.io/storj/storagenode/preflight.(*LocalTime).Check:96\n\tstorj.io/storj/storagenode.(*Peer).Run:489\n\tmain.cmdRun:206\n\tstorj.io/storj/pkg/process.cleanup.func1.2:299\n\tstorj.io/storj/pkg/process.cleanup.func1:317\n\tgithub.com/spf13/cobra.(*Command).execute:826\n\tgithub.com/spf13/cobra.(*Command).ExecuteC:914\n\tgithub.com/spf13/cobra.(*Command).Execute:864\n\tstorj.io/storj/pkg/process.ExecWithCustomConfig:79\n\tstorj.io/storj/pkg/process.Exec:61\n\tmain.(*service).Execute.func1:66\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-02-10T05:22:05.458+0100 INFO Configuration loaded from: C:\Program Files\Storj\Storage Node\config.yaml
2020-02-10T05:22:06.778+0100 INFO version running on version v0.30.5
2020-02-10T05:22:06.848+0100 INFO db.migration Database Version {“version”: 28}
2020-02-10T05:22:07.489+0100 INFO preflight:localtime start checking local system clock with trusted satellites’ system clock.
2020-02-10T05:22:08.552+0100 INFO preflight:localtime local system clock is in sync with trusted satellites’ system clock.
2020-02-10T05:22:08.553+0100 INFO trust Scheduling next refresh {“after”: “8h6m31.920116689s”}
2020-02-10T05:22:08.553+0100 INFO bandwidth Performing bandwidth usage rollups
2020-02-10T05:22:08.553+0100 INFO Node 124pEEUFEGQSmBHDM7cdcFxwM5iDNCmxFtsZqyriRwiSSUe8Jhz started
2020-02-10T05:22:08.554+0100 INFO Public server started on [::]:28967
2020-02-10T05:22:08.554+0100 INFO Private server started on 127.0.0.1:7778
2020-02-10T05:22:08.614+0100 INFO piecestore:monitor Remaining Bandwidth {“bytes”: 41827290874368}
2020-02-10T05:22:08.706+0100 INFO version running on version v0.30.5
2020-02-10T05:22:16.252+0100 INFO Interrogate request received.
2020-02-10T05:22:16.353+0100 INFO Stop/Shutdown request received.
2020-02-10T05:22:16.354+0100 ERROR contact:chore ping satellite failed {“Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “attempts”: 1, “error”: “ping satellite error: context canceled”, “errorVerbose”: “ping satellite error: context canceled\n\tstorj.io/storj/storagenode/contact.(*Chore).pingSatelliteOnce:167\n\tstorj.io/storj/storagenode/contact.(*Chore).pingSatellite:124\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:103\n\tstorj.io/common/sync2.(*Cycle).Run:87\n\tstorj.io/common/sync2.(*Cycle).Start.func1:68\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-02-10T05:22:16.354+0100 INFO contact:chore context cancelled {“Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”}
2020-02-10T05:22:16.354+0100 ERROR contact:chore ping satellite failed {“Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “attempts”: 1, “error”: “ping satellite error: context canceled”, “errorVerbose”: “ping satellite error: context canceled\n\tstorj.io/storj/storagenode/contact.(*Chore).pingSatelliteOnce:167\n\tstorj.io/storj/storagenode/contact.(*Chore).pingSatellite:124\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:103\n\tstorj.io/common/sync2.(*Cycle).Run:87\n\tstorj.io/common/sync2.(*Cycle).Start.func1:68\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-02-10T05:22:16.354+0100 ERROR contact:chore ping satellite failed {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “attempts”: 1, “error”: “ping satellite error: context canceled”, “errorVerbose”: “ping satellite error: context canceled\n\tstorj.io/storj/storagenode/contact.(*Chore).pingSatelliteOnce:167\n\tstorj.io/storj/storagenode/contact.(*Chore).pingSatellite:124\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:103\n\tstorj.io/common/sync2.(*Cycle).Run:87\n\tstorj.io/common/sync2.(*Cycle).Start.func1:68\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-02-10T05:22:16.354+0100 INFO contact:chore context cancelled {“Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”}
2020-02-10T05:22:16.354+0100 INFO contact:chore context cancelled {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”}
2020-02-10T05:22:16.354+0100 ERROR contact:chore ping satellite failed {“Satellite ID”: “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”, “attempts”: 1, “error”: “ping satellite error: context canceled”, “errorVerbose”: “ping satellite error: context canceled\n\tstorj.io/storj/storagenode/contact.(*Chore).pingSatelliteOnce:167\n\tstorj.io/storj/storagenode/contact.(*Chore).pingSatellite:124\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:103\n\tstorj.io/common/sync2.(*Cycle).Run:87\n\tstorj.io/common/sync2.(*Cycle).Start.func1:68\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-02-10T05:22:16.354+0100 INFO contact:chore context cancelled {“Satellite ID”: “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”}
2020-02-10T05:22:16.357+0100 ERROR piecestore:cache error getting current space used calculation: {“error”: “context canceled”}
2020-02-10T05:22:16.357+0100 ERROR piecestore:cache error during init space usage db: {“error”: “piece space used error: context canceled”, “errorVerbose”: “piece space used error: context canceled\n\tstorj.io/storj/storagenode/storagenodedb.(*pieceSpaceUsedDB).Init:71\n\tstorj.io/storj/storagenode/pieces.(*CacheService).Run:64\n\tstorj.io/storj/storagenode.(*Peer).Run.func6:477\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-02-10T05:22:16.357+0100 ERROR piecestore:cache error persisting cache totals to the database: {“error”: “piece space used error: context canceled”, “errorVerbose”: “piece space used error: context canceled\n\tstorj.io/storj/storagenode/storagenodedb.(*pieceSpaceUsedDB).UpdatePieceTotal:172\n\tstorj.io/storj/storagenode/pieces.(*CacheService).PersistCacheTotals:87\n\tstorj.io/storj/storagenode/pieces.(*CacheService).Run.func1:73\n\tstorj.io/common/sync2.(*Cycle).Run:87\n\tstorj.io/storj/storagenode/pieces.(*CacheService).Run:68\n\tstorj.io/storj/storagenode.(*Peer).Run.func6:477\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-02-10T05:22:16.363+0100 ERROR pieces:trash emptying trash failed {“error”: “pieces error: filestore error: context canceled”, “errorVerbose”: “pieces error: filestore error: context canceled\n\tstorj.io/storj/storage/filestore.(*blobStore).EmptyTrash:127\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).EmptyTrash:253\n\tstorj.io/storj/storagenode/pieces.(*Store).EmptyTrash:323\n\tstorj.io/storj/storagenode/pieces.(*TrashChore).Run.func1:51\n\tstorj.io/common/sync2.(*Cycle).Run:87\n\tstorj.io/common/sync2.(*Cycle).Start.func1:68\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-02-10T05:22:16.382+0100 ERROR pieces:trash emptying trash failed {“error”: “pieces error: filestore error: context canceled”, “errorVerbose”: “pieces error: filestore error: context canceled\n\tstorj.io/storj/storage/filestore.(*blobStore).EmptyTrash:127\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).EmptyTrash:253\n\tstorj.io/storj/storagenode/pieces.(*Store).EmptyTrash:323\n\tstorj.io/storj/storagenode/pieces.(*TrashChore).Run.func1:51\n\tstorj.io/common/sync2.(*Cycle).Run:87\n\tstorj.io/common/sync2.(*Cycle).Start.func1:68\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-02-10T05:22:16.395+0100 ERROR pieces:trash emptying trash failed {“error”: “pieces error: filestore error: context canceled”, “errorVerbose”: “pieces error: filestore error: context canceled\n\tstorj.io/storj/storage/filestore.(*blobStore).EmptyTrash:127\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).EmptyTrash:253\n\tstorj.io/storj/storagenode/pieces.(*Store).EmptyTrash:323\n\tstorj.io/storj/storagenode/pieces.(*TrashChore).Run.func1:51\n\tstorj.io/common/sync2.(*Cycle).Run:87\n\tstorj.io/common/sync2.(*Cycle).Start.func1:68\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-02-10T05:22:24.061+0100 INFO Configuration loaded from: C:\Program Files\Storj\Storage Node\config.yaml
2020-02-10T05:22:24.855+0100 INFO version running on version v0.31.12
2020-02-10T05:22:24.874+0100 INFO db.migration Database Version {“version”: 31}
2020-02-10T05:22:25.827+0100 INFO preflight:localtime start checking local system clock with trusted satellites’ system clock.
2020-02-10T05:22:26.005+0100 INFO Interrogate request received.
2020-02-10T05:22:26.758+0100 INFO preflight:localtime local system clock is in sync with trusted satellites’ system clock.
2020-02-10T05:22:26.758+0100 INFO trust Scheduling next refresh {“after”: “5h44m33.886616468s”}
2020-02-10T05:22:26.758+0100 INFO Node started
2020-02-10T05:22:26.758+0100 INFO Public server started on [::]:28967
2020-02-10T05:22:26.758+0100 INFO Private server started on 127.0.0.1:7778
2020-02-10T05:22:26.758+0100 INFO bandwidth Performing bandwidth usage rollups
2020-02-10T05:22:26.779+0100 INFO piecestore:monitor Remaining Bandwidth {“bytes”: 41827290874368}
2020-02-10T05:22:26.914+0100 INFO version running on version v0.31.12
2020-02-10T05:37:27.500+0100 INFO version running on version v0.31.12
Any idea how to resolve this issue ?