GET_REPAIR failed because of invalid signature

none it seems.

grep ERROR 2021-11-1*-sn0023* | grep GET_AUDIT
returns nothing.
grep ERROR 2021-11-1*-sn0023* | grep GET_REPAIR
also returns nothing.
so did a successrate… which also returns nothing.

./successrate.sh 2021-11-1*-sn0023*
========== AUDIT ==============
Critically failed:     0
Critical Fail Rate:    0.000%
Recoverable failed:    0
Recoverable Fail Rate: 0.000%
Successful:            1342
Success Rate:          100.000%
========== DOWNLOAD ===========
Failed:                661
Fail Rate:             1.621%
Canceled:              683
Cancel Rate:           1.675%
Successful:            39423
Success Rate:          96.703%
========== UPLOAD =============
Rejected:              0
Acceptance Rate:       100.000%
---------- accepted -----------
Failed:                58
Fail Rate:             0.030%
Canceled:              924
Cancel Rate:           0.480%
Successful:            191336
Success Rate:          99.489%
========== REPAIR DOWNLOAD ====
Failed:                0
Fail Rate:             0.000%
Canceled:              0
Cancel Rate:           0.000%
Successful:            2006
Success Rate:          100.000%
========== REPAIR UPLOAD ======
Failed:                4
Fail Rate:             0.018%
Canceled:              11
Cancel Rate:           0.050%
Successful:            21982
Success Rate:          99.932%
========== DELETE =============
Failed:                0
Fail Rate:             0.000%
Successful:            0
Success Rate:          0.000%

so yeah i duno, why it drops with no errors

grep ERROR 2021-11-16-sn00* | grep GET_REPAIR
2021-11-16-sn0001.log:2021-11-16T07:11:24.289Z  ERROR   piecestore      download failed {"Piece ID": "7W22ELF3HTYZFILT53XQVWNDJTSS7XUQAJ4PDNGKNLWVW5B2EWWA", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "GET_REPAIR", "error": "file does not exist", "errorVerbose": "file does not exist\n\tstorj.io/common/rpc/rpcstatus.Wrap:73\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:534\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:228\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:58\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:104\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:60\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:97\n\tstorj.io/drpc/drpcctx.(*Tracker).track:52"}

only error i can find is this one… also a node which dropped a bit in audit score for EU1

still no ZFS data errors recorded and my scrub is 78% done so the pool is looking fine.
never had more than one node drop i audit score before, and i know exactly why that happened because of a bad rsync -delete during a migration some 6 + months ago, so i excluded that one.

but i got 4 nodes showing drops in audit score for EU1 but doesn’t seem to show any errors for either of them.

This one affects audit score immediately. You should not exclude any errors, even if you know why is it happened.

Then it can be either timeout or piece corruption. There is only three possible ways - “not found”, “timeout” and “corrupted”.
Only the “corrupted” one could be hidden, except some weird errors when the header “has impossible size” (see [storagenode] pieces error: PieceHeader framing field claims impossible size of XXX bytes · Issue #4194 · storj/storj · GitHub)
Seems

is treated as “corrupted” too.

grep ERROR 2021-11-1*-sn0023* | grep impossible

returns nothing.

 grep ERROR 2021-11-1*-sn0023* | grep hash
2021-11-12-sn0023.log:2021-11-12T08:44:00.078Z  ERROR   piecestore      upload failed   {"Piece ID": "MTTMEPUVSVWJBGNMJD6QGU7QS5PTUN2K3JYFKUSCS3ZRQAQSZESA", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT_REPAIR", "error": "hashes don't match", "errorVerbose": "hashes don't match\n\tstorj.io/common/rpc/rpcstatus.Error:82\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).VerifyPieceHash:120\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:385\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:220\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:58\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:104\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:60\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:97\n\tstorj.io/drpc/drpcctx.(*Tracker).track:52", "Size": 37120}
2021-11-12-sn0023.log:2021-11-12T10:33:45.990Z  ERROR   piecestore      upload failed   {"Piece ID": "TB4LWLNWXOYOQTBCTNX23UIMN6W3RUVYWAI2GVWR66BH6YVO7SBA", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT_REPAIR", "error": "hashes don't match", "errorVerbose": "hashes don't match\n\tstorj.io/common/rpc/rpcstatus.Error:82\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).VerifyPieceHash:120\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:385\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:220\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:58\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:104\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:60\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:97\n\tstorj.io/drpc/drpcctx.(*Tracker).track:52", "Size": 2317056}
2021-11-14-sn0023.log:2021-11-14T10:58:23.100Z  ERROR   piecestore      upload failed   {"Piece ID": "YAUTLJVAKOT7BQKKZ7MPVVFTLPFKA27AD6GNVESF2ELLBRWSCJEA", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT_REPAIR", "error": "hashes don't match", "errorVerbose": "hashes don't match\n\tstorj.io/common/rpc/rpcstatus.Error:82\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).VerifyPieceHash:120\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:385\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:220\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:58\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:104\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:60\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:97\n\tstorj.io/drpc/drpcctx.(*Tracker).track:52", "Size": 2319360}
2021-11-14-sn0023.log:2021-11-14T20:53:46.864Z  ERROR   piecestore      upload failed   {"Piece ID": "M5YLVIJEFXZJ7O4OR5EVIIEB3XW6BNR4FHJ7FIQ2J4WDADEYLCUQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT_REPAIR", "error": "hashes don't match", "errorVerbose": "hashes don't match\n\tstorj.io/common/rpc/rpcstatus.Error:82\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).VerifyPieceHash:120\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:385\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:220\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:58\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:104\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:60\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:97\n\tstorj.io/drpc/drpcctx.(*Tracker).track:52", "Size": 221184}

returns a few but all uploads
and i think they are earlier than when the audit dropped.
checked the nodes audit scores on the 15th

grep ERROR 2021-11-1*-sn0023* | grep signature
also returns nothing

so i duno doubt my system is at fault, but at this rate we should start to see a lot of concerned people posting their dropping audit scores soon

The audit score is affected by GET_REPAIR and GET_AUDIT, no need to check any PUT

My nodes are affected, but only suspension score. Even on broken one from the exercise Moving from Windows to Ubuntu and back.

This node is still prone to errors from time to time due to [storagenode] pieces error: PieceHeader framing field claims impossible size of XXX bytes · Issue #4194 · storj/storj · GitHub

yeah, well i’m not having much luck with my logs it seems, i guess we will have to wait and see if other people show up with the same audit score drop for EU1 without any obvious cause.

You can use GET_REPAIR failed because of invalid signature - #37 by Pentium100 to see what’s the maximum timeout

so took the one you made instead.

cat /bitpool/storjlogs/2021-11-17-sn0001.log | grep 1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE | grep -E "GET_AUDIT" | jq -R '. | split("\t") | (.[4] | fromjson) as $body | {SatelliteID: $body."Satellite ID", ($body."Piece ID"): {(.[0]): .[3]}}' | jq -s 'reduce .[] as $item ({}; . * $item)'
{
  "SatelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE",
  "2E6WNYEFIPDP4ULYHZQE7X5HCRW76WSSWIAPYSPQQROLS2GKKTVQ": {
    "2021-11-17T00:01:46.861Z": "download started",
    "2021-11-17T00:01:47.063Z": "downloaded"
  },
  "EBCZZK5AOCOW5FEJK4IJZLBTCE7R44PLWH6XUZDRTQSE6VDIATHA": {
    "2021-11-17T00:02:58.995Z": "download started",
    "2021-11-17T00:02:59.201Z": "downloaded"
  },
  "5X5UDS2EFXZ57GWD4CXMFHR6AUV42Y4ILUWTSCITQKRYPEBONNEA": {
    "2021-11-17T00:08:10.248Z": "download started",
    "2021-11-17T00:08:10.541Z": "downloaded"
  },
  "36WEXYBPXOPOK22APBVHUL5DKPUNN7OH4JOYAK2DP3ISIH2KH6BA": {
    "2021-11-17T00:08:22.580Z": "download started",
    "2021-11-17T00:08:22.781Z": "downloaded"
  },
  "7VUVVDRYJQYG52YPEM35WVAGUWPAZGY7T2IXA5QQGH6Y6VAQPI3Q": {
    "2021-11-17T00:09:06.911Z": "download started",
    "2021-11-17T00:09:07.179Z": "downloaded"
  },
  "5SXTZKQHT7CFBO3NIYR5LZJ6K7QMHDMJW47KKWIA2M2EM3HT5ZRA": {
    "2021-11-17T00:10:50.947Z": "download started",
    "2021-11-17T00:10:51.193Z": "downloaded"
  },
  "PXKLAI4Q3NJT6TO2IAORZVOK7JWSSXUXM6SZZKAMZN6KGZGTXFIQ": {
    "2021-11-17T00:14:20.146Z": "download started",
    "2021-11-17T00:14:20.373Z": "downloaded"
  },
  "SWP3XN7AXB3WKNCK7CIZET2UUDCVEXVJ37ET5YK5Q6ESQ7Z2SPRQ": {
    "2021-11-17T00:16:44.318Z": "download started",
    "2021-11-17T00:16:44.531Z": "downloaded"
  },
  "7R35FRGMT3SPKPZ2G6CFGGNDJANIQFAG4DR4VGHDD46ZTJF4HSGQ": {
    "2021-11-17T00:33:34.762Z": "download started",
    "2021-11-17T00:33:34.972Z": "downloaded"
  },
  "6O3C5ZZNW7DQTTRHNC7TXGDLB23ZDA6NKTWNV4AUSZHSFOEJNDPA": {
    "2021-11-17T00:33:52.677Z": "download started",
    "2021-11-17T00:33:52.899Z": "downloaded"
  },
  "OO2JSKSDHNBZ3QIG6EKDWTRZUBGXCUXBQ42PHSA4STNPZ5JLOZUQ": {
    "2021-11-17T00:38:38.786Z": "download started",
    "2021-11-17T00:38:38.989Z": "downloaded"
  },
  "GADD5UGSEDWUN2HFA7UDLSSFJB64FPRKOSCG23X74FZPEY22XLBA": {
    "2021-11-17T00:39:01.361Z": "download started",
    "2021-11-17T00:39:01.578Z": "downloaded"
  },
  "WV6OFORVRXEWXIO3DXM6QJ7OBIK2VVGRRENX3LZKXSWXURIQUI4A": {
    "2021-11-17T00:39:22.778Z": "download started",
    "2021-11-17T00:39:23.021Z": "downloaded"
  },
  "BMK7WRDLJWJS2AATMAXIUXPTVDSFX3VM4ELHXLCMNGDXTEKHUPKA": {
    "2021-11-17T00:41:45.661Z": "download started",
    "2021-11-17T00:41:45.892Z": "downloaded"
  },
  "PYGAOMDST7MWO57OBZGNFUB4KVT5IMXCJHRXQZS4HWAAM3UGWPWA": {
    "2021-11-17T00:49:13.959Z": "download started",
    "2021-11-17T00:49:14.170Z": "downloaded"
  },
  "J5NQNV5WJFY2VOKZEKPSUKAF2GITCPAJHCABAUMYLQ3YARZGP4PA": {
    "2021-11-17T00:50:34.217Z": "download started",
    "2021-11-17T00:50:34.452Z": "downloaded"
  },
  "QJNGZBGKM524OYBTT3IFC2QBRGULJ5LUY3O2NU44FZVV3CXBXLPA": {
    "2021-11-17T00:58:44.891Z": "download started",
    "2021-11-17T00:58:45.131Z": "downloaded"
  },
  "L5GT75TASDM7BV5WHRH65TDSWTTSQ3RVWVHPED3GFHKHWMT4TUEA": {
    "2021-11-17T01:11:58.380Z": "download started",
    "2021-11-17T01:11:58.621Z": "downloaded"
  },
  "J6EWS3UWLILC67OFO4WGZIAW6AWH5X5KMEKR6FLW6IWIO7SOJ4VQ": {
    "2021-11-17T01:21:25.650Z": "download started",
    "2021-11-17T01:21:25.875Z": "downloaded"
  },
  "4UXSUMCFWBVXPWA43ZKCLXPVGBQOFGN3BTIV7OV7K4DHTNZ2HG3Q": {
    "2021-11-17T01:23:02.833Z": "download started",
    "2021-11-17T01:23:03.058Z": "downloaded"
  },
  "XUCW7WBM4RDMRSVIPX6WR2HKDXYLDTDRVDC6Y6A746RTAJ4FEMSA": {
    "2021-11-17T01:27:10.428Z": "download started",
    "2021-11-17T01:27:10.631Z": "downloaded"
  },
  "GI5OGZLZ6U6QRPAEQEY5LBEMXAMIXSMPRFXNJL4NVP7Z2KESOHSQ": {
    "2021-11-17T01:28:38.492Z": "download started",
    "2021-11-17T01:28:38.740Z": "downloaded"
  },
  "XOKRQIBSZROXHQ7GW3FPGCDOPDYJTFZXWNESATHCUQUYIYJNFRJA": {
    "2021-11-17T01:31:30.371Z": "download started",
    "2021-11-17T01:31:30.628Z": "downloaded"
  },
  "QFW6CNNGSUPALMX5NDIWY5KGVIMMPV5W52ABO6CJYUTE2NIQMCYA": {
    "2021-11-17T01:35:41.195Z": "download started",
    "2021-11-17T01:35:41.444Z": "downloaded"
  },
  "A5EZGAMHAT4AYT6K25KJVUL4DZOSAQ6K7BMC625N5PZHIG46EJPQ": {
    "2021-11-17T01:36:10.125Z": "download started",
    "2021-11-17T01:36:10.379Z": "downloaded"
  },
  "XHY7PEUQFDYOITMBV65OY3MFYZHGEI7TNZXA5CP3PBNVOPI5XCVA": {
    "2021-11-17T01:37:05.849Z": "download started",
    "2021-11-17T01:37:06.084Z": "downloaded"
  },
  "YLIH3Z4HR7RS4IHP74QFP63VSIFOP7MR5OKGGCNDMNTJWIW7UNHA": {
    "2021-11-17T01:38:57.090Z": "download started",
    "2021-11-17T01:38:57.304Z": "downloaded"
  },
  "KVCQ3UTTQ546OYCUX6AG6JQXNAPVFURDFRHTU52MV7ZOMRIT35OA": {
    "2021-11-17T01:45:20.638Z": "download started",
    "2021-11-17T01:45:20.883Z": "downloaded"
  },
  "7SDNWRQNEVO65KYR2R3X5WVQHSN6AEOGODM6KH54QE5LG6TDR3VA": {
    "2021-11-17T01:55:01.433Z": "download started",
    "2021-11-17T01:55:01.644Z": "downloaded"
  },
  "A64BHRSPAOWN3LHSLPTD6ZRQX4KYYWSZSUZXVOC6ST67XMXQSLVA": {
    "2021-11-17T01:57:18.982Z": "download started",
    "2021-11-17T01:57:19.203Z": "downloaded"
  },
  "DYHHZRSVDDTOSMPPN6BON3F763ERJXHCUUNM2CIIBM5ELA47K3PQ": {
    "2021-11-17T01:59:19.593Z": "download started",
    "2021-11-17T01:59:20.330Z": "downloaded"
  },
  "VIQPECSORZF6RP6PTYF2M64Z5LTW66ZDQT6SAHAL4QVKMVY2T4VQ": {
    "2021-11-17T02:00:01.239Z": "download started",
    "2021-11-17T02:00:01.497Z": "downloaded"
  },
  "JEMI472KOITW4ASEFNKZL6EOOGZDODNCGRKOWAVDCVWMPLKD75MA": {
    "2021-11-17T02:12:10.852Z": "download started",
    "2021-11-17T02:12:11.065Z": "downloaded"
  },
  "YZOGTCGQEE4GW3TUKAJ4YD55PG427WN3V47CBR37BOBVT2F4Q2CQ": {
    "2021-11-17T02:17:32.181Z": "download started",
    "2021-11-17T02:17:32.436Z": "downloaded"
  },
  "REVZKR3MLICYQKWHNOYGZTVPXOGVJCOJ7DLKSDV66VQS7FXDSNLQ": {
    "2021-11-17T02:19:41.446Z": "download started",
    "2021-11-17T02:19:41.698Z": "downloaded"
  },
  "K6LCUG3DJCONOOSXU4EOXXLZUQIAY36ZTLKAZUV42QWFFGBSFC2Q": {
    "2021-11-17T02:30:48.653Z": "download started",
    "2021-11-17T02:30:48.910Z": "downloaded"
  },
  "OZAILFUQWCN6CFSFS5KOAM5GMNWZVHL4S7QJTEX3RH37MX4Z3CFA": {
    "2021-11-17T02:30:48.888Z": "download started",
    "2021-11-17T02:30:49.131Z": "downloaded"
  },
  "VBQQNSJTQAIZSN5F7RWFPUIQ56SVYJYAKIXCZQOLDZU3WSTCEJKQ": {
    "2021-11-17T02:31:47.918Z": "download started",
    "2021-11-17T02:31:48.138Z": "downloaded"
  },
  "HYTWIITFVSYECDFRT5DM6M5TS6U3UEH5A2MRLAKIDCEIMSZQ65PA": {
    "2021-11-17T02:34:30.586Z": "download started",
    "2021-11-17T02:34:30.791Z": "downloaded"
  },
  "FBBQJ5CJM3DLXZOOSY5TZ3C47PS7TLZPEELE3PFFTPFLV2ATJ6IA": {
    "2021-11-17T02:36:37.964Z": "download started",
    "2021-11-17T02:36:38.172Z": "downloaded"
  },
  "S2LL4GV3ZACRV7HAQBC2S4Q4NMV747GGKLJX4ZP2RPDX3A74BHJQ": {
    "2021-11-17T02:37:17.300Z": "download started",
    "2021-11-17T02:37:17.523Z": "downloaded"
  },
  "AWXFKMW7LDKWYN2G7KBL3Z7ITDW3X67QIVZXH56OKUBOV2XNHLQA": {
    "2021-11-17T02:51:59.901Z": "download started",
    "2021-11-17T02:52:00.132Z": "downloaded"
  },
  "C7MESFYAPCM5Y63GTPGP5CGX66TC2AMB75H73XKQKOGMYCPCD3FA": {
    "2021-11-17T02:58:07.850Z": "download started",
    "2021-11-17T02:58:08.081Z": "downloaded"
  },
  "44SO7JVN7IF4KQ2G3572YU6Z2V25OHYQTEFPEAEU5EAHTHP7AO6Q": {
    "2021-11-17T03:06:38.292Z": "download started",
    "2021-11-17T03:06:38.495Z": "downloaded"
  },
  "V5FIPP7IZNWD76ANBPUYOX4CUNNEWW3LDRVFALPA6JVDQOFAPTTQ": {
    "2021-11-17T03:07:28.339Z": "download started",
    "2021-11-17T03:07:28.547Z": "downloaded"
  },
  "LDRBSMH6HFMRQ3FT6TDKO3JQV6VUBPEYVMPIFSVFSMVOWJ4TUTAA": {
    "2021-11-17T03:08:44.880Z": "download started",
    "2021-11-17T03:08:45.108Z": "downloaded"
  },
  "FJQKHP5BJ56C6HXAAOX7ZE73D4TPPW2N4UUXGP7HGVAG7N6SMZCA": {
    "2021-11-17T03:09:26.393Z": "download started",
    "2021-11-17T03:09:27.116Z": "downloaded"
  },
  "FHTIFNA2FE6OD7APV3F3PWKF32KQTHCC7ZHC44BTUAUCDKFVCYIQ": {
    "2021-11-17T03:12:04.593Z": "download started",
    "2021-11-17T03:12:04.789Z": "downloaded"
  },
  "D56FIKLZOKEQTAXGG63BIDT2H5SQ2RQNOR25VT2AEQSX3GS6DTLQ": {
    "2021-11-17T03:15:28.045Z": "download started",
    "2021-11-17T03:15:28.717Z": "downloaded"
  },
  "OATYVGDCZVNW5UARCTHETX6GFNUDETMUQMX2HOPRZJOVHSQHRJCQ": {
    "2021-11-17T03:20:00.666Z": "download started",
    "2021-11-17T03:20:00.865Z": "downloaded"
  },
  "3TZK4TI3BUKJP2TCAHM22JVWLFVXEBKVEYP6HHNPECRYFVCRNL2Q": {
    "2021-11-17T03:28:33.002Z": "download started",
    "2021-11-17T03:28:33.205Z": "downloaded"
  },
  "J72E3YMACO26G7S4E7F2EIJB7F7A4B5O24OG5HT2U3OPPQBI6LVA": {
    "2021-11-17T03:29:43.385Z": "download started",
    "2021-11-17T03:29:43.607Z": "downloaded"
  },
  "ILJQLRTVHYF2BWTZAPGMVNAOBPKLIVS4KKES6PJO5S3OWGBUAR4A": {
    "2021-11-17T03:36:16.633Z": "download started",
    "2021-11-17T03:36:16.880Z": "downloaded"
  },
  "RHV4EHTGSQMKZTDTBDIT6SRCTSOA2JUFGCCKUYJEMXJEDC56G74Q": {
    "2021-11-17T03:41:42.646Z": "download started",
    "2021-11-17T03:41:42.864Z": "downloaded"
  },
  "UKVBGMKEV45LUJ2VNQUU4UV7BFJSVDGRINGVY7G2Y6V2HJOUGOAA": {
    "2021-11-17T03:46:59.268Z": "download started",
    "2021-11-17T03:46:59.486Z": "downloaded"
  },
  "W6GBRPO46NIWCWCXUYOMEHJ6SGIIRG333ZLXUQEOK7DZEYHGBW7Q": {
    "2021-11-17T03:49:04.062Z": "download started",
    "2021-11-17T03:49:04.280Z": "downloaded"
  },
  "LWWZ66EK272JTG6GFNZEGOXE2RTLLSVMITVPZVFK3EL43XQBEYJQ": {
    "2021-11-17T03:50:07.637Z": "download started",
    "2021-11-17T03:50:07.838Z": "downloaded"
  },
  "PAVZDAY2F55MBGAALQKX6YY47D4YHYADL6AGN7FOPQE4OCOBDW2Q": {
    "2021-11-17T03:50:57.060Z": "download started",
    "2021-11-17T03:50:57.247Z": "downloaded"
  },
  "LPY4QVHHBKIAKXR6KX63NFGSRTWAEGPLD5CYLFRKLOIZDO6NHECA": {
    "2021-11-17T03:52:07.863Z": "download started",
    "2021-11-17T03:52:08.110Z": "downloaded"
  },
  "OIA3DR4KOHCDFFNOELUKGPZAJUIZC7ETZUU4Q6E26YU2R74DHNMA": {
    "2021-11-17T03:53:38.665Z": "download started",
    "2021-11-17T03:53:38.870Z": "downloaded"
  },
  "IBQ7FA2BU6QBSRSEX7QLNYIKNYV3PA3F467CEZARAAV5CQVR3SBA": {
    "2021-11-17T03:53:40.034Z": "download started",
    "2021-11-17T03:53:40.248Z": "downloaded"
  },
  "VNA2Y5ERGDSBSWBS3CCDXQQNSKXAJNGHEFTR56H2YH6CTWG4X25Q": {
    "2021-11-17T04:00:52.130Z": "download started",
    "2021-11-17T04:00:52.369Z": "downloaded"
  },
  "UV2J7C3XWR7RJILEUSAJ2ME7ZFPRB24PG5QYJYOT5TUNSBR43VPA": {
    "2021-11-17T04:09:22.338Z": "download started",
    "2021-11-17T04:09:22.554Z": "downloaded"
  },
  "GEXDZSUL32KD7HCPCJLLZ2ZQOIXNIYVKJGS6QH44UIAWKWBYI6AA": {
    "2021-11-17T04:09:46.688Z": "download started",
    "2021-11-17T04:09:46.902Z": "downloaded"
  },
  "MFM5GBTLMY2WSJHCXSAA3GN3UP4IGOQROQJWMCLBPUL5CGO4PTEQ": {
    "2021-11-17T04:13:19.258Z": "download started",
    "2021-11-17T04:13:19.473Z": "downloaded"
  },
  "SZACIUBNX322PMGSWQEPENCP736JV4BTR5ZYXKZZFNE77WPZQHQQ": {
    "2021-11-17T04:15:25.117Z": "download started",
    "2021-11-17T04:15:25.329Z": "downloaded"
  },
  "TIP23RMCOKFDKO5UK4D2NI5E6OUK5UCRUIM3KKNL2ZMCDQYQXSUA": {
    "2021-11-17T04:15:31.056Z": "download started",
    "2021-11-17T04:15:31.260Z": "downloaded"
  },
  "24W3VPT7PFNIJNG74XIZ4CZUJ3EDEWH54TZL77YGSJ7KRJX3GJGA": {
    "2021-11-17T04:15:34.425Z": "download started",
    "2021-11-17T04:15:34.683Z": "downloaded"
  },
  "2BFRTR2TE7NA3KRMZRQT6BOQNHWFCW2SZXPHA2SSBXJFHG4F3LVA": {
    "2021-11-17T04:19:08.931Z": "download started",
    "2021-11-17T04:19:09.138Z": "downloaded"
  },
  "HW6R36INWEW5I3CA7UYEGISK5JTVBHKAVODDENHN6BCX5DGMEA2A": {
    "2021-11-17T04:21:13.041Z": "download started",
    "2021-11-17T04:21:13.259Z": "downloaded"
  },
  "ERND35LVZIHVMWLPPKERAV2GURCBD3XZLG6ILZJYNCGH52PRP7ZA": {
    "2021-11-17T04:21:15.727Z": "download started",
    "2021-11-17T04:21:15.945Z": "downloaded"
  },
  "Z7E3YSMPKJRG4ZEWXTG56HBVPFHV776UQFE43R35VZ4M63326JNA": {
    "2021-11-17T04:28:58.980Z": "download started",
    "2021-11-17T04:28:59.214Z": "downloaded"
  },
  "EY3MMMZCRJ3L245VDMDV2OX6FN2FO6YD44TOYXYJ3UR7NWH5E5QQ": {
    "2021-11-17T04:30:02.675Z": "download started",
    "2021-11-17T04:30:03.376Z": "downloaded"
  },
  "R5FCLRC7OLAA36TIE64YWKCW5ZU6OCBAGNS2BB5OUD2TPXLQM55A": {
    "2021-11-17T04:37:21.015Z": "download started",
    "2021-11-17T04:37:21.229Z": "downloaded"
  },
  "NHKHMNJ24UOJLX24L75BVHRKH5V5MW5YTTQ6XLCXYT3IAVYATE6Q": {
    "2021-11-17T04:46:59.559Z": "download started",
    "2021-11-17T04:46:59.773Z": "downloaded"
  },
  "NRXCZIMJC7YTGYMLAXSNOLZ3Q3CDVGQFAOYT5CUQKG6NXUXRYXFA": {
    "2021-11-17T04:51:33.362Z": "download started",
    "2021-11-17T04:51:33.564Z": "downloaded"
  },
  "D2MCF4H6FXQCS64FBYGQVVHZUUTAY5PJF4NVMXTQSRKQNLNR5MDQ": {
    "2021-11-17T04:53:11.299Z": "download started",
    "2021-11-17T04:53:11.569Z": "downloaded"
  },
  "UQDHMOSIEBOAVRVBNTBZQAZHTLGEJNNI7G6I2XDGBZFUG2525IXQ": {
    "2021-11-17T05:01:11.930Z": "download started",
    "2021-11-17T05:01:12.142Z": "downloaded"
  },
  "GSARLDF7FHYKT5EBGFMQJONQ7ZMF5SQOVAJIJCVBYZXAZ2GNSUKQ": {
    "2021-11-17T05:01:56.726Z": "download started",
    "2021-11-17T05:01:56.927Z": "downloaded"
  },
  "6OLZIET6DGXIIV6QJEWORDOCDL2ECRGOLOLBGXGMHSVNW7L376RQ": {
    "2021-11-17T05:02:41.584Z": "download started",
    "2021-11-17T05:02:41.797Z": "downloaded"
  },
  "D7FISXJJ24AHCKU7U2UBC3TN6JG4WQN42APSHASMB75K2UTNP5QQ": {
    "2021-11-17T05:03:17.585Z": "download started",
    "2021-11-17T05:03:17.802Z": "downloaded"
  },
  "IO2W3YDGIRA5O2Y76XGSMG7SGC52DFNF7ZGT4A3EZRLM4GAP7HCA": {
    "2021-11-17T05:06:39.208Z": "download started",
    "2021-11-17T05:06:39.404Z": "downloaded"
  },
  "AO6OSV37J4LTSNNKZGFTZU6BWWX5RG4EXPRC4GQVE7235UAH73LA": {
    "2021-11-17T05:09:34.127Z": "download started",
    "2021-11-17T05:09:34.401Z": "downloaded"
  },
  "XJ4CEPETIVDYHLUFY73X663VXJZP7GKJN5YNC6NQPBJ5RAAKBY5Q": {
    "2021-11-17T05:22:51.672Z": "download started",
    "2021-11-17T05:22:51.873Z": "downloaded"
  },
  "GFDNMRQVSPY7OUFIZFBAZV5TC5XEWYK6K7ECDPV4WTS53RVGVKOQ": {
    "2021-11-17T05:25:44.425Z": "download started",
    "2021-11-17T05:25:44.641Z": "downloaded"
  },
  "YJQWDHBXT7GHSBKNC3F3GJ2PKMQC23YZYTGKT7ZH6U2RDKTO7LSA": {
    "2021-11-17T05:29:08.075Z": "download started",
    "2021-11-17T05:29:08.278Z": "downloaded"
  },
  "WUGU5REZOGC3MZG4Q7FXSTAFK6JYFXHXBAT73XTWULIKQO4DUSJA": {
    "2021-11-17T05:29:50.402Z": "download started",
    "2021-11-17T05:29:50.643Z": "downloaded"
  },
  "CSHALLAPWBQOKH5Z6KRCO2J7AF6L7TSZLMNNTPV35YVEYHZF7GZQ": {
    "2021-11-17T05:32:03.899Z": "download started",
    "2021-11-17T05:32:04.106Z": "downloaded"
  },
  "WT5XUDQADI3DYQS3O5EDLR52FXCSKGDSNRRZ6KXQ7SFAE3QS6WCQ": {
    "2021-11-17T05:36:37.303Z": "download started",
    "2021-11-17T05:36:37.522Z": "downloaded"
  },
  "VCO5EOEXPHDFKAHABIJE6Q56ZSIXS57E5SZTWPDKJD3E6KH4O4GQ": {
    "2021-11-17T05:36:47.499Z": "download started",
    "2021-11-17T05:36:47.711Z": "downloaded"
  },
  "4PXBFWBPWV3IWRJLBWB75QKK7GMI563H6QE6VTYDK2NAB5WDAQVQ": {
    "2021-11-17T05:38:43.812Z": "download started",
    "2021-11-17T05:38:44.036Z": "downloaded"
  },
  "7FFARR6MFPJLFI3XKBEVSTFYBHJCFJYRSY73HTKCDONLEC7F25ZQ": {
    "2021-11-17T05:39:24.220Z": "download started",
    "2021-11-17T05:39:24.422Z": "downloaded"
  },
  "RAYMWDHUMEFMQQ4JSZ6KMMLTRX2KIWJF6KWN3URCBTF5YUW7IESQ": {
    "2021-11-17T05:40:26.709Z": "download started",
    "2021-11-17T05:40:26.931Z": "downloaded"
  },
  "H74PLR7SIZB5L4A7XDEP7GY7X3XN7XSXKFCQUGCB725H5FF2UGFQ": {
    "2021-11-17T05:42:08.679Z": "download started",
    "2021-11-17T05:42:08.886Z": "downloaded"
  },
  "Q74EOHPWBLKVZONZLZ3XTSQODEWIW4LLQFTW75XY76RL5QKUBU6A": {
    "2021-11-17T05:42:14.941Z": "download started",
    "2021-11-17T05:42:15.188Z": "downloaded"
  },
  "L3AS7XYVF55BKAJCT5RQAQSF7UMV4T4IVOKOZEJTFI5TDEHZ33BA": {
    "2021-11-17T05:45:44.596Z": "download started",
    "2021-11-17T05:45:44.892Z": "downloaded"
  },
  "RCPG4PALMWLS4A3PO5OQ3MRZ2T7G7PTLZJS7MENKL7ORZVSKDMIA": {
    "2021-11-17T05:47:02.788Z": "download started",
    "2021-11-17T05:47:02.998Z": "downloaded"
  },
  "TDRH62WOA63PAPR6D4BHY7I3JBKF4PQOL5NP6KZQ7TEDQGYK7LIA": {
    "2021-11-17T05:52:52.953Z": "download started",
    "2021-11-17T05:52:53.187Z": "downloaded"
  },
  "NKR7F5YLSB45HHK6XSW5NXR42CIDYFKE5G2PSINUNEIUQYCEX4OQ": {
    "2021-11-17T05:57:25.339Z": "download started",
    "2021-11-17T05:57:25.534Z": "downloaded"
  },
  "NCMQ34SEZSVHTPCG2FGNUERUB5QQ7MSEKESDZT5WEXADHBJKT6JA": {
    "2021-11-17T05:57:43.587Z": "download started",
    "2021-11-17T05:57:43.811Z": "downloaded"
  },
  "NWCWGUUTS26J6UXTIYBHK377E2E4UD7K5AIYKKKHDGHKK6ZWEPRA": {
    "2021-11-17T05:58:36.592Z": "download started",
    "2021-11-17T05:58:36.833Z": "downloaded"
  },
  "FORWIZWHCBXUOE3AHJTGP4J7PT2ZFP75JNUKR46P4QFBRCZF3QBQ": {
    "2021-11-17T05:58:58.527Z": "download started",
    "2021-11-17T05:58:58.745Z": "downloaded"
  },
  "2LQ3JGZPIHVSVDHJDUYY7O732VZIVY3BZUEECUZL25C64H4XGB5Q": {
    "2021-11-17T06:00:26.158Z": "download started",
    "2021-11-17T06:00:26.354Z": "downloaded"
  },
  "EPZTJXUVKRJG4Q627RCJTRJFCD3NURYY2PBBFA7GNJLWJSS7DOAQ": {
    "2021-11-17T06:02:42.210Z": "download started",
    "2021-11-17T06:02:42.419Z": "downloaded"
  },
  "3UHJ7THHVMPAVFZ7GNJ6XFUNUNET5APXSFKEO2T6C3YLBYJW6JAQ": {
    "2021-11-17T06:07:05.634Z": "download started",
    "2021-11-17T06:07:05.851Z": "downloaded"
  },
  "A7MBIGFRCOJ566ZE6HK3JE7H6C32GWYP7LCVDHKB572FPGFOKNWA": {
    "2021-11-17T06:08:37.507Z": "download started",
    "2021-11-17T06:08:37.709Z": "downloaded"
  },
  "VZHZ5ACM2I5BASTV7IAONVZ4AHPOP7EQXTJZLA3E4BIZWG5LR44Q": {
    "2021-11-17T06:09:21.419Z": "download started",
    "2021-11-17T06:09:21.631Z": "downloaded"
  },
  "LJIQN3NDB7R3ZZRA3HLMJ5EOFSUD4N4LFT4SUOLA7LVODWNAHWSQ": {
    "2021-11-17T06:11:21.580Z": "download started",
    "2021-11-17T06:11:21.778Z": "downloaded"
  },
  "Q4BKUNYM3LENW5RKYNLPAU6SJLO7JHOI4GFJWUVI746DAZAQKRPA": {
    "2021-11-17T06:12:03.083Z": "download started",
    "2021-11-17T06:12:03.298Z": "downloaded"
  },
  "MYVW6AJV7FBCJ7DS5NPZAKRKFABKAXA5ZDMPPFHOVAKJTUVZRJPQ": {
    "2021-11-17T06:16:06.128Z": "download started",
    "2021-11-17T06:16:06.413Z": "downloaded"
  },
  "5QTTKAN75ZTJ7AD4LJ4MNGELQZIWFKB3OO7JNBVPSNKD2KNTEXKQ": {
    "2021-11-17T06:25:04.574Z": "download started",
    "2021-11-17T06:25:04.795Z": "downloaded"
  },
  "IXBHK7JZQEE53ITJ33C42LFPLDHBKU6VSCYNQJIFP73U7SG2EHCA": {
    "2021-11-17T06:25:30.267Z": "download started",
    "2021-11-17T06:25:30.510Z": "downloaded"
  },
  "PDQG2IJX3QZMDSQRD7FRBWU753ZSEEADAUJGOI3XMPGNZ3OMEEUQ": {
    "2021-11-17T06:26:45.492Z": "download started",
    "2021-11-17T06:26:45.714Z": "downloaded"
  },
  "ZNWKHMFNOU4J6RNMM44U5O36DBPCKRIJCW5PLUKNZEYNVT7ZKO6A": {
    "2021-11-17T06:32:02.580Z": "download started",
    "2021-11-17T06:32:02.790Z": "downloaded"
  },
  "B2WL7LG2BV26RGF2FK7NX4YGF3EBKTENQCB2BF76KH5VHZDUZFEA": {
    "2021-11-17T06:32:06.486Z": "download started",
    "2021-11-17T06:32:06.676Z": "downloaded"
  },
  "AGROIGJH6767W2SYVDUUFKAJGYAZO5ICJNJZE4DELJO5BAJ5CXXA": {
    "2021-11-17T06:37:55.442Z": "download started",
    "2021-11-17T06:37:55.669Z": "downloaded"
  },
  "SLDD3QUXUDQBTHWSH5YYKU7W4WY4HT7DVHLTEPJ5OF4IMFKYY22Q": {
    "2021-11-17T06:38:45.387Z": "download started",
    "2021-11-17T06:38:45.572Z": "downloaded"
  },
  "4NN65I5KZTJG45KGK5X2YAMPGHLGQFDEJCGTKFTYVIIWYJYEW2VA": {
    "2021-11-17T06:41:58.992Z": "download started",
    "2021-11-17T06:41:59.210Z": "downloaded"
  },
  "P4SNZIUQU2VW2KKHU7IFSPOHKGXBBLLQGLZCXJM74SQ3XUNNGOHA": {
    "2021-11-17T06:42:03.037Z": "download started",
    "2021-11-17T06:42:03.261Z": "downloaded"
  },
  "OJKFCSLU32GITQEKCR43Z57EM4F6OUT2NISN2XGJK2K6MIAZ5DMQ": {
    "2021-11-17T06:42:09.443Z": "download started",
    "2021-11-17T06:42:09.647Z": "downloaded"
  },
  "K2VGHENGUMC7ENHHVXKS6JS2XITAIACGIRK4DUNMBCOLEFSZKG7A": {
    "2021-11-17T06:43:22.759Z": "download started",
    "2021-11-17T06:43:22.967Z": "downloaded"
  },
  "KAC6YQOQYXANULLVIQHZ6ZAGVDSOBBRR7DWNMANUSGBW2DSP6I4Q": {
    "2021-11-17T06:48:33.436Z": "download started",
    "2021-11-17T06:48:33.684Z": "downloaded"
  },
  "X2VIUZF2E6IUWTRMWPP5QJS5GYLHCXK2URWHUHEWSQK6G4G247UA": {
    "2021-11-17T06:50:55.494Z": "download started",
    "2021-11-17T06:50:55.688Z": "downloaded"
  },
  "HT4OECVRJWMSB5PTC6Z3CX6VNT5TCXNC3V6OCZUWD3TXQB6ANQNQ": {
    "2021-11-17T06:51:19.372Z": "download started",
    "2021-11-17T06:51:19.586Z": "downloaded"
  },
  "7DY4OFVW5EMM6QQ7ES5IVJGWF254VWMVMPVDED5YIWOLYPVCTDTQ": {
    "2021-11-17T06:54:53.381Z": "download started",
    "2021-11-17T06:54:53.589Z": "downloaded"
  },
  "Y6JZ43OVI4ZSPW4ADPUITKIFFJK3477DOGCPKC5754YECDTEQPLQ": {
    "2021-11-17T06:55:37.416Z": "download started",
    "2021-11-17T06:55:37.633Z": "downloaded"
  },
  "LHZRZW5GVFELSUNM4FZDYAQHGJ3V7BRCYLPBGXQWK3W3TLUQJU2A": {
    "2021-11-17T06:55:39.421Z": "download started",
    "2021-11-17T06:55:39.627Z": "downloaded"
  },
  "IZRNRA6FJRA6JCKECTJG4X2UY5LUL5Z2B4TBZIPJATRGYHILZEMA": {
    "2021-11-17T07:11:23.272Z": "download started",
    "2021-11-17T07:11:23.464Z": "downloaded"
  },
  "5W66IIPD7SHSYG6PRKSEKBJFRGZYJO7HTNEW2AGDPNPXSLWSACEA": {
    "2021-11-17T07:11:45.708Z": "download started",
    "2021-11-17T07:11:45.917Z": "downloaded"
  },
  "EI3I3ABI62HNYDIPOO4Z2AUQQA5XSQ5WI5XHJNXOQV5KDCNWMDPA": {
    "2021-11-17T07:11:46.684Z": "download started",
    "2021-11-17T07:11:46.933Z": "downloaded"
  },
  "JZU4XCSPKZA2XO6YFF3ERSXYNE43SPNEITR5R3VNA4QUQPU4QTZQ": {
    "2021-11-17T07:14:50.276Z": "download started",
    "2021-11-17T07:14:50.478Z": "downloaded"
  },
  "64P4UFIAX6CBVLL55J26L4PKB4PWQHNHEQXGBTAW2QB4T6XLMFAA": {
    "2021-11-17T07:15:02.348Z": "download started",
    "2021-11-17T07:15:02.557Z": "downloaded"
  },
  "YH2V7ISNLVQEJSWX5QIDAGFNBTAF4EXA3OGCB4D2QDCL6UUJ6LOA": {
    "2021-11-17T07:16:18.352Z": "download started",
    "2021-11-17T07:16:18.568Z": "downloaded"
  },
  "QJ6SL7H6EAVT4RWSBUCEABMFVW37COSRKCHUHOQAPKQHT4SDZ45Q": {
    "2021-11-17T07:27:09.253Z": "download started",
    "2021-11-17T07:27:09.507Z": "downloaded"
  },
  "EEGRNBESCO7AGZQEMZV3KTJVRWWZK7KISG6ZVBBFEABQV3TDFI3Q": {
    "2021-11-17T07:27:40.359Z": "download started",
    "2021-11-17T07:27:40.597Z": "downloaded"
  },
  "PZ43F5TF2CUF2RK45MG6W3ED7C7GINF7YS42BC2TPFXBDS4K4YRA": {
    "2021-11-17T07:28:46.881Z": "download started",
    "2021-11-17T07:28:47.126Z": "downloaded"
  },
  "FVIHHRTP673KVQ74HEZGUEPMAROPIB7KUG2XHJTHSZJST2F3ZHLA": {
    "2021-11-17T07:28:49.828Z": "download started",
    "2021-11-17T07:28:50.035Z": "downloaded"
  },
  "SR62IQCPHNCFZGDHJV4TMNLX7YYLLSV64SULLX2WULB6RUFUXK5Q": {
    "2021-11-17T07:33:28.551Z": "download started",
    "2021-11-17T07:33:28.815Z": "downloaded"
  },
  "OD3JFWIWZU5XR5LCDHUCK5I3WF4ONXGSNBZMDVQLGH6NEFYJXM4Q": {
    "2021-11-17T07:39:01.794Z": "download started",
    "2021-11-17T07:39:02.011Z": "downloaded"
  },
  "IVYH6MZCMPGXQ53OWELMQREZKNE3SAFMLZLZUZ4PUXDNSUCZCHHA": {
    "2021-11-17T07:40:08.786Z": "download started",
    "2021-11-17T07:40:08.997Z": "downloaded"
  },
  "ATRKRYUJXQF2M6YV2Z2AAY5CAEWWWVRZAW6VVS6BXO5YISYOOVXQ": {
    "2021-11-17T07:46:03.564Z": "download started",
    "2021-11-17T07:46:03.768Z": "downloaded"
  },
  "XOECSTNU47C5HKYRKNASNQ6QWAQAI3O5OSDVQEVYGE242KGFTSFQ": {
    "2021-11-17T07:47:26.765Z": "download started",
    "2021-11-17T07:47:27.051Z": "downloaded"
  },
  "2LBIY46TRPQOVTQHVDI6UUGZNJFX6MAZYSC65CHVO4HW5MKRJ3VA": {
    "2021-11-17T07:47:43.849Z": "download started",
    "2021-11-17T07:47:44.053Z": "downloaded"
  },
  "UL7FWYD4KBWPOGCMQYSDMNVDAKF7KC3PBZBOVFA7BNDO7MNWRFDA": {
    "2021-11-17T07:48:47.032Z": "download started",
    "2021-11-17T07:48:47.261Z": "downloaded"
  },
  "VWN3PAAPM5Q7Q5D3Q3UVH7IFRMC2ZZUZ75BFBTEGJSLZ3ZE2YEMA": {
    "2021-11-17T07:49:09.645Z": "download started",
    "2021-11-17T07:49:09.851Z": "downloaded"
  },
  "Z2WDDFZB3EN2XCOXFHUK67HEPNWQ2MAPV3IO5QVALCPTXWVOM25A": {
    "2021-11-17T07:49:44.226Z": "download started",
    "2021-11-17T07:49:44.441Z": "downloaded"
  },
  "LDPQ2S5KUGSSVTSZUITM65X3HRMQPLZX7K5BNQ5PQ2O3GWC2M3DQ": {
    "2021-11-17T07:49:49.415Z": "download started",
    "2021-11-17T07:49:49.636Z": "downloaded"
  },
  "WUAVNYKBEIXQURYZQV6XHSXRTI3GSPL6BF2KUN742QAFMBRUP4DQ": {
    "2021-11-17T07:52:36.101Z": "download started",
    "2021-11-17T07:52:36.333Z": "downloaded"
  },
  "OULS2YWAW5P6YAIOG26UVXCG6IJIFZLVF7WY5FFY6QNHSHQMUWIA": {
    "2021-11-17T07:55:28.717Z": "download started",
    "2021-11-17T07:55:28.941Z": "downloaded"
  },
  "SO7KD3OOZ5OMXM23AO5FO2C3ALRZRDOJSTKV2Z3LQUPADMV44Y2A": {
    "2021-11-17T07:57:10.556Z": "download started",
    "2021-11-17T07:57:10.771Z": "downloaded"
  },
  "QPBLWN77VVAB427LQQKIVD2M4UUVB455T3347I7LBVZWHCR4WACA": {
    "2021-11-17T08:06:20.600Z": "download started",
    "2021-11-17T08:06:20.861Z": "downloaded"
  },
  "VVDZGSUJ23L6AR3BXKEEV6Q4VJWMUCMKVKAJ3XJQSXQ63A4ODQIA": {
    "2021-11-17T08:17:26.168Z": "download started",
    "2021-11-17T08:17:26.458Z": "downloaded"
  },
  "5N5O7DNU3QIU34GKBAJ44QHA33BVYODKVBXJBPZ4GIIZCJ6CRNMQ": {
    "2021-11-17T08:19:02.583Z": "download started",
    "2021-11-17T08:19:02.796Z": "downloaded"
  },
  "2EBWWR7ES7KBPBZA2KERHQ3N6DTVYEZ2RZJXOPZ2KBXYQSXLJCGA": {
    "2021-11-17T08:19:06.797Z": "download started",
    "2021-11-17T08:19:07.018Z": "downloaded"
  },
  "3O4KPDIWL4VTPK2W6AYHIIE57AHWJWKAI4UGU56OQD4T3FZ245EA": {
    "2021-11-17T08:28:51.626Z": "download started",
    "2021-11-17T08:28:51.871Z": "downloaded"
  },
  "C6SFJA64T7QQHFIWPKEG2F5LHBUISX27Y5YT7G672ZGYYLRGRWJQ": {
    "2021-11-17T08:29:29.684Z": "download started",
    "2021-11-17T08:29:29.900Z": "downloaded"
  },
  "TWTENR3M62F6JYPR3KW6TK7Z2LEPSYLWH4IVDKJTQ752PE6XQBOA": {
    "2021-11-17T08:30:00.494Z": "download started",
    "2021-11-17T08:30:00.717Z": "downloaded"
  },
  "W3Y3GNQSQY4LWY6TGYPDIQMCK7W43EHDPTUYGPIHULJPMVOJ5EOA": {
    "2021-11-17T08:32:20.841Z": "download started",
    "2021-11-17T08:32:21.067Z": "downloaded"
  },
  "73H3NT7JVHIPD2HAYQ42MGX5EKP2D6RCVUUFXCPDA2PGM3T2JRKQ": {
    "2021-11-17T08:34:54.577Z": "download started",
    "2021-11-17T08:34:54.770Z": "downloaded"
  },
  "57U4WYP5PXALXWOH5YP26XYTSX6XLQSZ3SBGIIW7YI5HPUSWM5TA": {
    "2021-11-17T08:50:55.307Z": "download started",
    "2021-11-17T08:50:55.507Z": "downloaded"
  },
  "4PCIYPWZDODVOWF4WKZS33NWIEI7VAJLOOUUQNO77KNR6VKJQHTQ": {
    "2021-11-17T08:51:58.809Z": "download started",
    "2021-11-17T08:51:59.176Z": "downloaded"
  },
  "UZGVCZUTPABQEJNRV33PGRONR2ACWCXPFTEY4ZYUJYGJG43RUPLA": {
    "2021-11-17T08:54:59.466Z": "download started",
    "2021-11-17T08:54:59.696Z": "downloaded"
  },
  "KO3FMXN2GLCO7AF337OCSGLKWZAYTMGJCTMZSUEI6NIS64RHORKA": {
    "2021-11-17T09:00:58.158Z": "download started",
    "2021-11-17T09:00:58.397Z": "downloaded"
  },
  "T5QDV3ZK4OFDVBNYQANYDCQYZGVBB6WH3I5YUSNKHCLSYCFE2JIA": {
    "2021-11-17T09:02:37.282Z": "download started",
    "2021-11-17T09:02:37.512Z": "downloaded"
  },
  "D2TYEUNWJZNNF6JLPTMHC2X2BAOFHP3EIFH4EKWYESCSMLH34ZBQ": {
    "2021-11-17T09:03:18.651Z": "download started",
    "2021-11-17T09:03:18.857Z": "downloaded"
  },
  "IUGITPDJZNT5NKC5CGZNYD5SONGXMZQEMALZ63FC2XRKR7TWPRCQ": {
    "2021-11-17T09:18:26.953Z": "download started",
    "2021-11-17T09:18:27.174Z": "downloaded"
  },
  "J6FDYRM25DZDKMGUVGMTUMEFVWWL5BJBSQQMYQBQFVMLH4JTYO3Q": {
    "2021-11-17T09:20:33.087Z": "download started",
    "2021-11-17T09:20:33.294Z": "downloaded"
  },
  "5XUC6AACRYGVYTYVYVNVLID7ISZORBQNSKMGB4C6OM7LB7BRKYSQ": {
    "2021-11-17T09:23:01.405Z": "download started",
    "2021-11-17T09:23:01.608Z": "downloaded"
  },
  "H2N3PUNTUFO76NBFYWRPSFLTI45FXXBL7TYY7DNJWFI4YK524FEA": {
    "2021-11-17T09:29:03.562Z": "download started",
    "2021-11-17T09:29:03.783Z": "downloaded"
  },
  "5FW44EUABI4QW26S5B47GGEPXEA4OBE6Z5RKUDPT5M5GQZBVHYFA": {
    "2021-11-17T09:32:43.562Z": "download started",
    "2021-11-17T09:32:43.767Z": "downloaded"
  },
  "F2IEQ4K6JQG3QA6OUFHFM7367HEGMDSBXOCAMFBER6QSH75K26AQ": {
    "2021-11-17T09:42:50.138Z": "download started",
    "2021-11-17T09:42:50.355Z": "downloaded"
  },
  "4BXPWIYAK5HRY6FKM43JYTZ6XCIHAHOI2S7W6DP5G4NZJQSYPITA": {
    "2021-11-17T09:50:37.113Z": "download started",
    "2021-11-17T09:50:37.344Z": "downloaded"
  },
  "XYWR6LH7KBUNVAMLJUMNSSDESNDP3DC5MTJ6HQKL2IWAFUDC6ZSQ": {
    "2021-11-17T09:54:56.401Z": "download started",
    "2021-11-17T09:54:56.610Z": "downloaded"
  },
  "ZVM23NH5P2RX37XFB7KCXU3RVSKCXDFOH3D3EGDW3UXLWAHGNRRQ": {
    "2021-11-17T09:59:08.886Z": "download started",
    "2021-11-17T09:59:09.165Z": "downloaded"
  },
  "U3INLFE2THRFJ7D3ZYMIS7VB22FLRDAAA2L2DVPZWYSVULCMNBLA": {
    "2021-11-17T10:01:25.678Z": "download started",
    "2021-11-17T10:01:25.884Z": "downloaded"
  },
  "XVUQOS3WB536IUWCQGXO5FCJT4NUSOQ453BOPFGKO7C3QOX6YVXQ": {
    "2021-11-17T10:04:47.954Z": "download started",
    "2021-11-17T10:04:48.168Z": "downloaded"
  },
  "DR53MGB4MFAPEWU4CPVFN3KGR647L3KPERNA7HORYDEYC534Y7RA": {
    "2021-11-17T10:07:00.181Z": "download started",
    "2021-11-17T10:07:00.439Z": "downloaded"
  },
  "4SGQDLGCUDYDVUIP2YQQLH4GB2RNDWTO5RSRKCXIQSXBU3I7TYBQ": {
    "2021-11-17T10:27:48.517Z": "download started",
    "2021-11-17T10:27:48.729Z": "downloaded"
  },
  "L7SQMKVFFBYB67MKP647I7RTYL6KC35WBNCUJN2GYNDXIADRLQIA": {
    "2021-11-17T10:28:32.395Z": "download started",
    "2021-11-17T10:28:32.604Z": "downloaded"
  },
  "5DBGJS7FWEVDW45NF6LOWUZRXL7EJNE67ZWRY2WCC63CPHVF6XCA": {
    "2021-11-17T10:37:13.593Z": "download started",
    "2021-11-17T10:37:13.829Z": "downloaded"
  },
  "NOSAVJ624JKT274PFKVY5YQA43UG7ASZB547YA7NV2I76PBAR3OQ": {
    "2021-11-17T10:38:44.679Z": "download started",
    "2021-11-17T10:38:44.919Z": "downloaded"
  },
  "LARJFVFDCLHQFZEMACP2QB6ACNSSFZN6BQMPKCVAMN3V3XPJU7SA": {
    "2021-11-17T10:40:21.821Z": "download started",
    "2021-11-17T10:40:22.027Z": "downloaded"
  },
  "NTYTV6PBXEZ3JMOCHJDOYGSCLMIJDIXEKVW3RLSWBNFPVYCINT2A": {
    "2021-11-17T10:43:35.665Z": "download started",
    "2021-11-17T10:43:35.864Z": "downloaded"
  },
  "T72ERKUIYCWGQO7WGSIPA37R76RGVEJ66MBGQRRKNE4P4ZQUM24A": {
    "2021-11-17T10:49:25.483Z": "download started",
    "2021-11-17T10:49:25.693Z": "downloaded"
  },
  "CROZ4PUOA66ZHOI7347APYKC7HS3ZM35N4WU74ZWQNRRB6SFEXWQ": {
    "2021-11-17T11:00:05.156Z": "download started",
    "2021-11-17T11:00:05.387Z": "downloaded"
  },
  "64UTS32ONY7XBIADDHOF5OLNUGQPHZI2KQW2X6DHA5JGOEGHCWNA": {
    "2021-11-17T11:03:18.395Z": "download started",
    "2021-11-17T11:03:18.636Z": "downloaded"
  },
  "E224VJIGKAJKL4Z32HBCVVYBXDSZ23TGC3B43ESC4JRAPCFSQ7DA": {
    "2021-11-17T11:09:21.853Z": "download started",
    "2021-11-17T11:09:22.063Z": "downloaded"
  },
  "SAVJG7ZMUVY6K4W7EX3J5JW2PFXI3CACBBM7QOS26Z7RGNOFSDYQ": {
    "2021-11-17T11:11:15.076Z": "download started",
    "2021-11-17T11:11:15.323Z": "downloaded"
  },
  "Z75JDMEMJNM7PXVCMEOJ7UT3SAGW77YR3BLCA2POYY7ADWIBXVEA": {
    "2021-11-17T11:11:58.612Z": "download started",
    "2021-11-17T11:11:58.878Z": "downloaded"
  },
  "ONWDYYYICFPTEHZEFW2KUDSOR3WG2YW3YZW5K4S7LUHJYG3IPLTA": {
    "2021-11-17T11:12:24.706Z": "download started",
    "2021-11-17T11:12:24.906Z": "downloaded"
  },
  "7X3IPMWHPMLBFKSPGBAPSTADYV6VYCWQ5HBLKROI4R5L3TO5ZUQQ": {
    "2021-11-17T11:20:47.896Z": "download started",
    "2021-11-17T11:20:48.111Z": "downloaded"
  },
  "XNE2VIDAYETYP6TPWUKF2EARHRA43FPIRMEAGZPTAOF5HAPNHUAA": {
    "2021-11-17T11:20:56.739Z": "download started",
    "2021-11-17T11:20:57.031Z": "downloaded"
  },
  "FNRO5IG35AUWYJJXHKOLJ2J64EORIAXSSBKXS5FM6KEO6UEUV63A": {
    "2021-11-17T11:21:52.003Z": "download started",
    "2021-11-17T11:21:52.218Z": "downloaded"
  },
  "YGMCNFUUCGZWKD6LDKISGMV22KHEUEM2ZKZOYTUOACMBDFREYLGA": {
    "2021-11-17T11:21:54.707Z": "download started",
    "2021-11-17T11:21:54.921Z": "downloaded"
  },
  "JJ5KOAPUAKAKGCJDXVC5K7TZQXLTX4DIGO4NGBQ5RRK3XEYSVUMQ": {
    "2021-11-17T11:22:45.372Z": "download started",
    "2021-11-17T11:22:45.573Z": "downloaded"
  },
  "QU3H72XCCGWTFFCFS2M47NGFHLNGHFNVU6H4V5HIA5LTYD54CNPA": {
    "2021-11-17T11:24:30.747Z": "download started",
    "2021-11-17T11:24:30.966Z": "downloaded"
  },
  "2VZ5RCESZSTLRQUSILNYHVMZUIAPMJTEKQ73EEKYOMOPXWWO6H6Q": {
    "2021-11-17T11:31:18.439Z": "download started",
    "2021-11-17T11:31:18.692Z": "downloaded"
  },
  "EN7DZKBULGHHABAN2CFQPS4VHRDBDCWHPI22EZN4KV4DMKISH6KQ": {
    "2021-11-17T11:32:31.657Z": "download started",
    "2021-11-17T11:32:31.865Z": "downloaded"
  }
}

avg seems still be like 200-300ms found one that is 800ms and one or two that is 400-500ms

Last error of this type in my logs was in November 22. Did you manage to fix it or is my node just lucky to not encounter these errors?

1 Like

Devs should have stopped the faulty worker. It may be turned on again to gather more information as to why it is not working as expected with the same software and configurations as others.
More like a hardware issue, but investigation is still in progress.

2 Likes