Good day everyone, I have had a node working since Dec 2020 and today for the fist time I noticed by Audit Score went down from 100%. I check the log files and found it was caused by a failed download of
“Piece ID”: “7TY7QPN7OYI4NRKAVSHYR4426UT3UGLBQPH4TJYE3XNFIRHN4NUQ”
I quickly went to check the health of the hard drive but it seemed fine. No IO errors. I also check if the file exists and it does, it is a 1.5K file.
root@miner: ls -lh | grep ‘y7q’
-rw------- 1 root root 1.5K Dec 7 2021 y7qpn7oyi4nrkavshyr4426ut3uglbqph4tjye3xnfirhn4nuq.sj1
The log file contains
cat /mnt/node2/node.log | grep ‘Y7QPN’
2022-10-26T12:48:08.740-0600 INFO piecestore download started {“Process”: “storagenode”, “Piece ID”: “7TY7QPN7OYI4NRKAVSHYR4426UT3UGLBQPH4TJYE3XNFIRHN4NUQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET_AUDIT”}
2022-10-26T12:48:08.977-0600 INFO piecestore downloaded {“Process”: “storagenode”, “Piece ID”: “7TY7QPN7OYI4NRKAVSHYR4426UT3UGLBQPH4TJYE3XNFIRHN4NUQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET_AUDIT”}
2022-10-26T12:48:11.914-0600 INFO piecestore download started {“Process”: “storagenode”, “Piece ID”: “7TY7QPN7OYI4NRKAVSHYR4426UT3UGLBQPH4TJYE3XNFIRHN4NUQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET_AUDIT”}
2022-10-26T12:48:11.916-0600 ERROR piecestore download failed {“Process”: “storagenode”, “Piece ID”: “7TY7QPN7OYI4NRKAVSHYR4426UT3UGLBQPH4TJYE3XNFIRHN4NUQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET_AUDIT”, “error”: “use of closed network connection”, “errorVerbose”: “use of closed network connection\n\tstorj.io/drpc/drpcstream.(*Stream).rawFlushLocked:356\n\tstorj.io/drpc/drpcstream.(*Stream).MsgSend:408\n\tstorj.io/common/pb.(*drpcPiecestore_DownloadStream).Send:317\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download.func5.1:628\n\tstorj.io/common/rpc/rpctimeout.Run.func1:22”}