Storj service keeps stoping GUI

Hello,

I am running node on Windows GUI, after recent node update the service keeps stoping every 4min30s. From log it looks that it can not access a directory. Is there a way to solve this? Here are the logs:

2020-10-04T07:27:10.242+0300 INFO piecestore download started {“Piece ID”: “W5M7DYLF4Z35THO642NODHTJTE4PJST3GYUITPCGVPWRPBWORWHQ”, “Satellite ID”: “1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE”, “Action”: “GET”}
2020-10-04T07:27:10.423+0300 INFO piecestore download started {“Piece ID”: “UMHF46CTRAYG3VB4FHPNMPAIENM2ZYA6L7E5HJGDQ3DWLF474OTQ”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “GET”}
2020-10-04T07:27:10.545+0300 INFO piecestore downloaded {“Piece ID”: “UMHF46CTRAYG3VB4FHPNMPAIENM2ZYA6L7E5HJGDQ3DWLF474OTQ”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “GET”}
2020-10-04T07:27:10.597+0300 INFO piecestore download started {“Piece ID”: “E5ZSZYPHZYUEABJOCKTW3EMHXH3LIR3ZZTJ7BSRCLRGUABTSQAPA”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “GET”}
2020-10-04T07:27:11.127+0300 INFO piecestore downloaded {“Piece ID”: “E5ZSZYPHZYUEABJOCKTW3EMHXH3LIR3ZZTJ7BSRCLRGUABTSQAPA”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “GET”}
2020-10-04T07:27:11.500+0300 INFO piecestore download started {“Piece ID”: “UMHF46CTRAYG3VB4FHPNMPAIENM2ZYA6L7E5HJGDQ3DWLF474OTQ”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “GET”}
2020-10-04T07:27:11.656+0300 INFO piecestore downloaded {“Piece ID”: “UMHF46CTRAYG3VB4FHPNMPAIENM2ZYA6L7E5HJGDQ3DWLF474OTQ”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “GET”}
2020-10-04T07:27:11.882+0300 ERROR nodestats:cache Get held amount query failed {“error”: “payout service error: unable to connect to the satellite 118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW: rpc: context deadline exceeded”, “errorVerbose”: “payout service error: unable to connect to the satellite 118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW: rpc: context deadline exceeded\n\tstorj.io/storj/storagenode/payout.(*Endpoint).dial:229\n\tstorj.io/storj/storagenode/payout.(*Endpoint).GetPaystub:56\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheHeldAmount.func1:202\n\tstorj.io/storj/storagenode/nodestats.(*Cache).satelliteLoop:259\n\tstorj.io/storj/storagenode/nodestats.(*Cache).CacheHeldAmount:194\n\tstorj.io/storj/storagenode/nodestats.(*Cache).Run.func3:136\n\tstorj.io/common/sync2.(*Cycle).Run:92\n\tstorj.io/common/sync2.(*Cycle).Start.func1:71\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-10-04T07:27:12.072+0300 INFO piecestore download started {“Piece ID”: “IPB2CMLK77C6HZSILBCCZXKCSOKXZ4ERIPS63CFVZN4KDMXYDJTA”, “Satellite ID”: “1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE”, “Action”: “GET”}
2020-10-04T07:27:12.769+0300 INFO piecestore download started {“Piece ID”: “CZUJV453QBWO3VY4M5DOVBYOPEWYMQQ5FY2HLI2RHMCY7NXMOZYA”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “GET_REPAIR”}
2020-10-04T07:27:12.964+0300 INFO piecestore uploaded {“Piece ID”: “6Z3MGLR6U6LTP6BFBVKIIGOW7VAKNQG7WQ6A5ETWCIEQR2ZENY7Q”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “PUT_REPAIR”}
2020-10-04T07:27:13.305+0300 INFO piecestore downloaded {“Piece ID”: “CZUJV453QBWO3VY4M5DOVBYOPEWYMQQ5FY2HLI2RHMCY7NXMOZYA”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “GET_REPAIR”}
2020-10-04T07:27:13.327+0300 INFO piecestore downloaded {“Piece ID”: “W5M7DYLF4Z35THO642NODHTJTE4PJST3GYUITPCGVPWRPBWORWHQ”, “Satellite ID”: “1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE”, “Action”: “GET”}
2020-10-04T07:27:15.149+0300 INFO piecestore downloaded {“Piece ID”: “IPB2CMLK77C6HZSILBCCZXKCSOKXZ4ERIPS63CFVZN4KDMXYDJTA”, “Satellite ID”: “1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE”, “Action”: “GET”}
2020-10-04T07:27:16.199+0300 ERROR contact:service ping satellite failed {“Satellite ID”: “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”, “attempts”: 7, “error”: “ping satellite error: rpc: context deadline exceeded”, “errorVerbose”: “ping satellite error: rpc: context deadline exceeded\n\tstorj.io/common/rpc.Dialer.dialTransport:211\n\tstorj.io/common/rpc.Dialer.dial:188\n\tstorj.io/common/rpc.Dialer.DialNodeURL:148\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatelliteOnce:124\n\tstorj.io/storj/storagenode/contact.(*Service).pingSatellite:95\n\tstorj.io/storj/storagenode/contact.(*Chore).updateCycles.func1:87\n\tstorj.io/common/sync2.(*Cycle).Run:92\n\tstorj.io/common/sync2.(*Cycle).Start.func1:71\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-10-04T07:27:16.929+0300 ERROR piecestore:cache error getting current space used calculation: {“error”: “FindNextFile F:\storage\blobs\ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa\tp: The file or directory is corrupted and unreadable.”}
2020-10-04T07:27:16.930+0300 ERROR services unexpected shutdown of a runner {“name”: “piecestore:cache”, “error”: “FindNextFile F:\storage\blobs\ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa\tp: The file or directory is corrupted and unreadable.”}
2020-10-04T07:27:16.930+0300 INFO contact:service context cancelled {“Satellite ID”: “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”}
2020-10-04T07:27:17.430+0300 ERROR servers unexpected shutdown of a runner {“name”: “debug”, “error”: “debug: http: Server closed”, “errorVerbose”: “debug: http: Server closed\n\tstorj.io/private/debug.(*Server).Run.func2:108\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2020-10-04T07:27:17.585+0300 FATAL Unrecoverable error {“error”: “FindNextFile F:\storage\blobs\ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa\tp: The file or directory is corrupted and unreadable.”}

Welcome to the forum @t0mast!

You should stop your node and run chkdsk on that drive asap.

2 Likes

Hello
I have the same problem.
Unrecoverable error {“error”: "CreateFile The file or directory is corrupted and unreadable.

I have ran check disk several times this month. I think the HDD has developped bad sectors. But how do I isolate these sectors? I thought check disk can do that, but it appears it only fixes the files or the pointers to the files. I am not sure. The drive is 1,5TB and it is almost full. It has 50 or 70 GB free. What would you advise me to do? My raiting/audits dropped to 50%. Should I try and migrate/clone the data to another drive?

Thank you in advance!

BR,
Niki

You can use a GUI check in the disk properties and select a surface scan or from the elevated cmd.exe:

chkdsk /F /R D:

Where is D: is a name of the disk.
If your audit rate is dropped lower than 60% on the dashboard, your node is disqualified already.

Actually it did not get disqualified. After I fixed the errors on the disk and actually few weeks after that the satelites all show above 90%