Lessons learned
Truncated files do not cause audit failures
Here is the error in the log
| 2020-08-21T04:11:44.264Z | INFO | piecestore | download started | {“Piece ID”: “RSUABYEMSEBEUWYHF77AM65ZR5QLCR476VSKQTPHA7WJKTTA3ZIA”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “GET_AUDIT”} |
|---|---|---|---|---|
| 2020-08-21T04:11:44.287Z | ERROR | piecestore | download failed | {“Piece ID”: “RSUABYEMSEBEUWYHF77AM65ZR5QLCR476VSKQTPHA7WJKTTA3ZIA”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “GET_AUDIT”, “error”: “requested more data than available, requesting=512 available=1”, “errorVerbose”: “requested more data than available, requesting=512 available=1\n\tstorj.io/common/rpc/rpcstatus.Errorf:87\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:545\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:1004\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:107\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:56\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:111\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:62\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:99\n\tstorj.io/drpc/drpcctx.(*Tracker).track:51”} |
and here is the result
us-central-1 1 2020-08-09 0.00 USD 0.0022 USD 75% 0.0017 USD 0.0006 USD
Status: 11% Vetted >> Audit[0.0% DQ|0.0% Susp]
europe-west-1 1 2020-08-09 0.00 USD 0.0016 USD 75% 0.0012 USD 0.0004 USD
Status: 9% Vetted >> Audit[0.0% DQ|29.0% Susp]
europe-north-1 1 2020-08-09 0.00 USD 0.0004 USD 75% 0.0003 USD 0.0001 USD
Status: 14% Vetted >> Audit[0.0% DQ|22.3% Susp]
asia-east-1 1 2020-08-09 0.00 USD 0.0019 USD 75% 0.0014 USD 0.0005 USD
Status: 10% Vetted >> Audit[0.0% DQ|50.1% Susp]
saltlake 1 2020-08-09 0.00 USD 0.0335 USD 75% 0.0252 USD 0.0084 USD
Status: 18% Vetted >> Audit[0.0% DQ|0.0% Susp]
stefan-benten 1 2020-08-09 0.00 USD 0.0001 USD 75% 0.0001 USD 0.0000 USD
Status: 5% Vetted >> Audit[0.0% DQ|0.0% Susp]
Surprising that completely obliterating the data results in only suspension!
Using the wrong dbs copied from another node
2020-08-21T06:23:03.258Z ERROR orders.12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs rpc client error when receiving new order settlements {“error”: “order: failed to receive settlement response: only specified storage node can settle order”, “errorVerbose”: “order: failed to receive settlement response: only specified storage node can settle order\n\tstorj.io/storj/storagenode/orders.(*Service).settle:330\n\tstorj.io/storj/storagenode/orders.(*Service).Settle:221\n\tstorj.io/storj/storagenode/orders.(*Service).sendOrders.func2:200\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}