GET_REPAIR failed because of invalid signature

Node Operators troubleshooting
42

This one affects audit score immediately. You should not exclude any errors, even if you know why is it happened.

Then it can be either timeout or piece corruption. There is only three possible ways - “not found”, “timeout” and “corrupted”.
Only the “corrupted” one could be hidden, except some weird errors when the header “has impossible size” (see [storagenode] pieces error: PieceHeader framing field claims impossible size of XXX bytes · Issue #4194 · storj/storj · GitHub)
Seems

is treated as “corrupted” too.

43

grep ERROR 2021-11-1*-sn0023* | grep impossible

returns nothing.

 grep ERROR 2021-11-1*-sn0023* | grep hash
2021-11-12-sn0023.log:2021-11-12T08:44:00.078Z  ERROR   piecestore      upload failed   {"Piece ID": "MTTMEPUVSVWJBGNMJD6QGU7QS5PTUN2K3JYFKUSCS3ZRQAQSZESA", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT_REPAIR", "error": "hashes don't match", "errorVerbose": "hashes don't match\n\tstorj.io/common/rpc/rpcstatus.Error:82\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).VerifyPieceHash:120\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:385\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:220\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:58\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:104\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:60\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:97\n\tstorj.io/drpc/drpcctx.(*Tracker).track:52", "Size": 37120}
2021-11-12-sn0023.log:2021-11-12T10:33:45.990Z  ERROR   piecestore      upload failed   {"Piece ID": "TB4LWLNWXOYOQTBCTNX23UIMN6W3RUVYWAI2GVWR66BH6YVO7SBA", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT_REPAIR", "error": "hashes don't match", "errorVerbose": "hashes don't match\n\tstorj.io/common/rpc/rpcstatus.Error:82\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).VerifyPieceHash:120\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:385\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:220\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:58\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:104\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:60\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:97\n\tstorj.io/drpc/drpcctx.(*Tracker).track:52", "Size": 2317056}
2021-11-14-sn0023.log:2021-11-14T10:58:23.100Z  ERROR   piecestore      upload failed   {"Piece ID": "YAUTLJVAKOT7BQKKZ7MPVVFTLPFKA27AD6GNVESF2ELLBRWSCJEA", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT_REPAIR", "error": "hashes don't match", "errorVerbose": "hashes don't match\n\tstorj.io/common/rpc/rpcstatus.Error:82\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).VerifyPieceHash:120\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:385\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:220\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:58\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:104\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:60\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:97\n\tstorj.io/drpc/drpcctx.(*Tracker).track:52", "Size": 2319360}
2021-11-14-sn0023.log:2021-11-14T20:53:46.864Z  ERROR   piecestore      upload failed   {"Piece ID": "M5YLVIJEFXZJ7O4OR5EVIIEB3XW6BNR4FHJ7FIQ2J4WDADEYLCUQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT_REPAIR", "error": "hashes don't match", "errorVerbose": "hashes don't match\n\tstorj.io/common/rpc/rpcstatus.Error:82\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).VerifyPieceHash:120\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:385\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:220\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:58\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:104\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:60\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:97\n\tstorj.io/drpc/drpcctx.(*Tracker).track:52", "Size": 221184}

returns a few but all uploads
and i think they are earlier than when the audit dropped.
checked the nodes audit scores on the 15th

grep ERROR 2021-11-1*-sn0023* | grep signature
also returns nothing

so i duno doubt my system is at fault, but at this rate we should start to see a lot of concerned people posting their dropping audit scores soon

44

The audit score is affected by GET_REPAIR and GET_AUDIT, no need to check any PUT

My nodes are affected, but only suspension score. Even on broken one from the exercise Moving from Windows to Ubuntu and back.

This node is still prone to errors from time to time due to [storagenode] pieces error: PieceHeader framing field claims impossible size of XXX bytes · Issue #4194 · storj/storj · GitHub

45

yeah, well i’m not having much luck with my logs it seems, i guess we will have to wait and see if other people show up with the same audit score drop for EU1 without any obvious cause.

46

You can use GET_REPAIR failed because of invalid signature - #37 by Pentium100 to see what’s the maximum timeout

48

so took the one you made instead.

cat /bitpool/storjlogs/2021-11-17-sn0001.log | grep 1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE | grep -E "GET_AUDIT" | jq -R '. | split("\t") | (.[4] | fromjson) as $body | {SatelliteID: $body."Satellite ID", ($body."Piece ID"): {(.[0]): .[3]}}' | jq -s 'reduce .[] as $item ({}; . * $item)'
{
  "SatelliteID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE",
  "2E6WNYEFIPDP4ULYHZQE7X5HCRW76WSSWIAPYSPQQROLS2GKKTVQ": {
    "2021-11-17T00:01:46.861Z": "download started",
    "2021-11-17T00:01:47.063Z": "downloaded"
  },
  "EBCZZK5AOCOW5FEJK4IJZLBTCE7R44PLWH6XUZDRTQSE6VDIATHA": {
    "2021-11-17T00:02:58.995Z": "download started",
    "2021-11-17T00:02:59.201Z": "downloaded"
  },
  "5X5UDS2EFXZ57GWD4CXMFHR6AUV42Y4ILUWTSCITQKRYPEBONNEA": {
    "2021-11-17T00:08:10.248Z": "download started",
    "2021-11-17T00:08:10.541Z": "downloaded"
  },
  "36WEXYBPXOPOK22APBVHUL5DKPUNN7OH4JOYAK2DP3ISIH2KH6BA": {
    "2021-11-17T00:08:22.580Z": "download started",
    "2021-11-17T00:08:22.781Z": "downloaded"
  },
  "7VUVVDRYJQYG52YPEM35WVAGUWPAZGY7T2IXA5QQGH6Y6VAQPI3Q": {
    "2021-11-17T00:09:06.911Z": "download started",
    "2021-11-17T00:09:07.179Z": "downloaded"
  },
  "5SXTZKQHT7CFBO3NIYR5LZJ6K7QMHDMJW47KKWIA2M2EM3HT5ZRA": {
    "2021-11-17T00:10:50.947Z": "download started",
    "2021-11-17T00:10:51.193Z": "downloaded"
  },
  "PXKLAI4Q3NJT6TO2IAORZVOK7JWSSXUXM6SZZKAMZN6KGZGTXFIQ": {
    "2021-11-17T00:14:20.146Z": "download started",
    "2021-11-17T00:14:20.373Z": "downloaded"
  },
  "SWP3XN7AXB3WKNCK7CIZET2UUDCVEXVJ37ET5YK5Q6ESQ7Z2SPRQ": {
    "2021-11-17T00:16:44.318Z": "download started",
    "2021-11-17T00:16:44.531Z": "downloaded"
  },
  "7R35FRGMT3SPKPZ2G6CFGGNDJANIQFAG4DR4VGHDD46ZTJF4HSGQ": {
    "2021-11-17T00:33:34.762Z": "download started",
    "2021-11-17T00:33:34.972Z": "downloaded"
  },
  "6O3C5ZZNW7DQTTRHNC7TXGDLB23ZDA6NKTWNV4AUSZHSFOEJNDPA": {
    "2021-11-17T00:33:52.677Z": "download started",
    "2021-11-17T00:33:52.899Z": "downloaded"
  },
  "OO2JSKSDHNBZ3QIG6EKDWTRZUBGXCUXBQ42PHSA4STNPZ5JLOZUQ": {
    "2021-11-17T00:38:38.786Z": "download started",
    "2021-11-17T00:38:38.989Z": "downloaded"
  },
  "GADD5UGSEDWUN2HFA7UDLSSFJB64FPRKOSCG23X74FZPEY22XLBA": {
    "2021-11-17T00:39:01.361Z": "download started",
    "2021-11-17T00:39:01.578Z": "downloaded"
  },
  "WV6OFORVRXEWXIO3DXM6QJ7OBIK2VVGRRENX3LZKXSWXURIQUI4A": {
    "2021-11-17T00:39:22.778Z": "download started",
    "2021-11-17T00:39:23.021Z": "downloaded"
  },
  "BMK7WRDLJWJS2AATMAXIUXPTVDSFX3VM4ELHXLCMNGDXTEKHUPKA": {
    "2021-11-17T00:41:45.661Z": "download started",
    "2021-11-17T00:41:45.892Z": "downloaded"
  },
  "PYGAOMDST7MWO57OBZGNFUB4KVT5IMXCJHRXQZS4HWAAM3UGWPWA": {
    "2021-11-17T00:49:13.959Z": "download started",
    "2021-11-17T00:49:14.170Z": "downloaded"
  },
  "J5NQNV5WJFY2VOKZEKPSUKAF2GITCPAJHCABAUMYLQ3YARZGP4PA": {
    "2021-11-17T00:50:34.217Z": "download started",
    "2021-11-17T00:50:34.452Z": "downloaded"
  },
  "QJNGZBGKM524OYBTT3IFC2QBRGULJ5LUY3O2NU44FZVV3CXBXLPA": {
    "2021-11-17T00:58:44.891Z": "download started",
    "2021-11-17T00:58:45.131Z": "downloaded"
  },
  "L5GT75TASDM7BV5WHRH65TDSWTTSQ3RVWVHPED3GFHKHWMT4TUEA": {
    "2021-11-17T01:11:58.380Z": "download started",
    "2021-11-17T01:11:58.621Z": "downloaded"
  },
  "J6EWS3UWLILC67OFO4WGZIAW6AWH5X5KMEKR6FLW6IWIO7SOJ4VQ": {
    "2021-11-17T01:21:25.650Z": "download started",
    "2021-11-17T01:21:25.875Z": "downloaded"
  },
  "4UXSUMCFWBVXPWA43ZKCLXPVGBQOFGN3BTIV7OV7K4DHTNZ2HG3Q": {
    "2021-11-17T01:23:02.833Z": "download started",
    "2021-11-17T01:23:03.058Z": "downloaded"
  },
  "XUCW7WBM4RDMRSVIPX6WR2HKDXYLDTDRVDC6Y6A746RTAJ4FEMSA": {
    "2021-11-17T01:27:10.428Z": "download started",
    "2021-11-17T01:27:10.631Z": "downloaded"
  },
  "GI5OGZLZ6U6QRPAEQEY5LBEMXAMIXSMPRFXNJL4NVP7Z2KESOHSQ": {
    "2021-11-17T01:28:38.492Z": "download started",
    "2021-11-17T01:28:38.740Z": "downloaded"
  },
  "XOKRQIBSZROXHQ7GW3FPGCDOPDYJTFZXWNESATHCUQUYIYJNFRJA": {
    "2021-11-17T01:31:30.371Z": "download started",
    "2021-11-17T01:31:30.628Z": "downloaded"
  },
  "QFW6CNNGSUPALMX5NDIWY5KGVIMMPV5W52ABO6CJYUTE2NIQMCYA": {
    "2021-11-17T01:35:41.195Z": "download started",
    "2021-11-17T01:35:41.444Z": "downloaded"
  },
  "A5EZGAMHAT4AYT6K25KJVUL4DZOSAQ6K7BMC625N5PZHIG46EJPQ": {
    "2021-11-17T01:36:10.125Z": "download started",
    "2021-11-17T01:36:10.379Z": "downloaded"
  },
  "XHY7PEUQFDYOITMBV65OY3MFYZHGEI7TNZXA5CP3PBNVOPI5XCVA": {
    "2021-11-17T01:37:05.849Z": "download started",
    "2021-11-17T01:37:06.084Z": "downloaded"
  },
  "YLIH3Z4HR7RS4IHP74QFP63VSIFOP7MR5OKGGCNDMNTJWIW7UNHA": {
    "2021-11-17T01:38:57.090Z": "download started",
    "2021-11-17T01:38:57.304Z": "downloaded"
  },
  "KVCQ3UTTQ546OYCUX6AG6JQXNAPVFURDFRHTU52MV7ZOMRIT35OA": {
    "2021-11-17T01:45:20.638Z": "download started",
    "2021-11-17T01:45:20.883Z": "downloaded"
  },
  "7SDNWRQNEVO65KYR2R3X5WVQHSN6AEOGODM6KH54QE5LG6TDR3VA": {
    "2021-11-17T01:55:01.433Z": "download started",
    "2021-11-17T01:55:01.644Z": "downloaded"
  },
  "A64BHRSPAOWN3LHSLPTD6ZRQX4KYYWSZSUZXVOC6ST67XMXQSLVA": {
    "2021-11-17T01:57:18.982Z": "download started",
    "2021-11-17T01:57:19.203Z": "downloaded"
  },
  "DYHHZRSVDDTOSMPPN6BON3F763ERJXHCUUNM2CIIBM5ELA47K3PQ": {
    "2021-11-17T01:59:19.593Z": "download started",
    "2021-11-17T01:59:20.330Z": "downloaded"
  },
  "VIQPECSORZF6RP6PTYF2M64Z5LTW66ZDQT6SAHAL4QVKMVY2T4VQ": {
    "2021-11-17T02:00:01.239Z": "download started",
    "2021-11-17T02:00:01.497Z": "downloaded"
  },
  "JEMI472KOITW4ASEFNKZL6EOOGZDODNCGRKOWAVDCVWMPLKD75MA": {
    "2021-11-17T02:12:10.852Z": "download started",
    "2021-11-17T02:12:11.065Z": "downloaded"
  },
  "YZOGTCGQEE4GW3TUKAJ4YD55PG427WN3V47CBR37BOBVT2F4Q2CQ": {
    "2021-11-17T02:17:32.181Z": "download started",
    "2021-11-17T02:17:32.436Z": "downloaded"
  },
  "REVZKR3MLICYQKWHNOYGZTVPXOGVJCOJ7DLKSDV66VQS7FXDSNLQ": {
    "2021-11-17T02:19:41.446Z": "download started",
    "2021-11-17T02:19:41.698Z": "downloaded"
  },
  "K6LCUG3DJCONOOSXU4EOXXLZUQIAY36ZTLKAZUV42QWFFGBSFC2Q": {
    "2021-11-17T02:30:48.653Z": "download started",
    "2021-11-17T02:30:48.910Z": "downloaded"
  },
  "OZAILFUQWCN6CFSFS5KOAM5GMNWZVHL4S7QJTEX3RH37MX4Z3CFA": {
    "2021-11-17T02:30:48.888Z": "download started",
    "2021-11-17T02:30:49.131Z": "downloaded"
  },
  "VBQQNSJTQAIZSN5F7RWFPUIQ56SVYJYAKIXCZQOLDZU3WSTCEJKQ": {
    "2021-11-17T02:31:47.918Z": "download started",
    "2021-11-17T02:31:48.138Z": "downloaded"
  },
  "HYTWIITFVSYECDFRT5DM6M5TS6U3UEH5A2MRLAKIDCEIMSZQ65PA": {
    "2021-11-17T02:34:30.586Z": "download started",
    "2021-11-17T02:34:30.791Z": "downloaded"
  },
  "FBBQJ5CJM3DLXZOOSY5TZ3C47PS7TLZPEELE3PFFTPFLV2ATJ6IA": {
    "2021-11-17T02:36:37.964Z": "download started",
    "2021-11-17T02:36:38.172Z": "downloaded"
  },
  "S2LL4GV3ZACRV7HAQBC2S4Q4NMV747GGKLJX4ZP2RPDX3A74BHJQ": {
    "2021-11-17T02:37:17.300Z": "download started",
    "2021-11-17T02:37:17.523Z": "downloaded"
  },
  "AWXFKMW7LDKWYN2G7KBL3Z7ITDW3X67QIVZXH56OKUBOV2XNHLQA": {
    "2021-11-17T02:51:59.901Z": "download started",
    "2021-11-17T02:52:00.132Z": "downloaded"
  },
  "C7MESFYAPCM5Y63GTPGP5CGX66TC2AMB75H73XKQKOGMYCPCD3FA": {
    "2021-11-17T02:58:07.850Z": "download started",
    "2021-11-17T02:58:08.081Z": "downloaded"
  },
  "44SO7JVN7IF4KQ2G3572YU6Z2V25OHYQTEFPEAEU5EAHTHP7AO6Q": {
    "2021-11-17T03:06:38.292Z": "download started",
    "2021-11-17T03:06:38.495Z": "downloaded"
  },
  "V5FIPP7IZNWD76ANBPUYOX4CUNNEWW3LDRVFALPA6JVDQOFAPTTQ": {
    "2021-11-17T03:07:28.339Z": "download started",
    "2021-11-17T03:07:28.547Z": "downloaded"
  },
  "LDRBSMH6HFMRQ3FT6TDKO3JQV6VUBPEYVMPIFSVFSMVOWJ4TUTAA": {
    "2021-11-17T03:08:44.880Z": "download started",
    "2021-11-17T03:08:45.108Z": "downloaded"
  },
  "FJQKHP5BJ56C6HXAAOX7ZE73D4TPPW2N4UUXGP7HGVAG7N6SMZCA": {
    "2021-11-17T03:09:26.393Z": "download started",
    "2021-11-17T03:09:27.116Z": "downloaded"
  },
  "FHTIFNA2FE6OD7APV3F3PWKF32KQTHCC7ZHC44BTUAUCDKFVCYIQ": {
    "2021-11-17T03:12:04.593Z": "download started",
    "2021-11-17T03:12:04.789Z": "downloaded"
  },
  "D56FIKLZOKEQTAXGG63BIDT2H5SQ2RQNOR25VT2AEQSX3GS6DTLQ": {
    "2021-11-17T03:15:28.045Z": "download started",
    "2021-11-17T03:15:28.717Z": "downloaded"
  },
  "OATYVGDCZVNW5UARCTHETX6GFNUDETMUQMX2HOPRZJOVHSQHRJCQ": {
    "2021-11-17T03:20:00.666Z": "download started",
    "2021-11-17T03:20:00.865Z": "downloaded"
  },
  "3TZK4TI3BUKJP2TCAHM22JVWLFVXEBKVEYP6HHNPECRYFVCRNL2Q": {
    "2021-11-17T03:28:33.002Z": "download started",
    "2021-11-17T03:28:33.205Z": "downloaded"
  },
  "J72E3YMACO26G7S4E7F2EIJB7F7A4B5O24OG5HT2U3OPPQBI6LVA": {
    "2021-11-17T03:29:43.385Z": "download started",
    "2021-11-17T03:29:43.607Z": "downloaded"
  },
  "ILJQLRTVHYF2BWTZAPGMVNAOBPKLIVS4KKES6PJO5S3OWGBUAR4A": {
    "2021-11-17T03:36:16.633Z": "download started",
    "2021-11-17T03:36:16.880Z": "downloaded"
  },
  "RHV4EHTGSQMKZTDTBDIT6SRCTSOA2JUFGCCKUYJEMXJEDC56G74Q": {
    "2021-11-17T03:41:42.646Z": "download started",
    "2021-11-17T03:41:42.864Z": "downloaded"
  },
  "UKVBGMKEV45LUJ2VNQUU4UV7BFJSVDGRINGVY7G2Y6V2HJOUGOAA": {
    "2021-11-17T03:46:59.268Z": "download started",
    "2021-11-17T03:46:59.486Z": "downloaded"
  },
  "W6GBRPO46NIWCWCXUYOMEHJ6SGIIRG333ZLXUQEOK7DZEYHGBW7Q": {
    "2021-11-17T03:49:04.062Z": "download started",
    "2021-11-17T03:49:04.280Z": "downloaded"
  },
  "LWWZ66EK272JTG6GFNZEGOXE2RTLLSVMITVPZVFK3EL43XQBEYJQ": {
    "2021-11-17T03:50:07.637Z": "download started",
    "2021-11-17T03:50:07.838Z": "downloaded"
  },
  "PAVZDAY2F55MBGAALQKX6YY47D4YHYADL6AGN7FOPQE4OCOBDW2Q": {
    "2021-11-17T03:50:57.060Z": "download started",
    "2021-11-17T03:50:57.247Z": "downloaded"
  },
  "LPY4QVHHBKIAKXR6KX63NFGSRTWAEGPLD5CYLFRKLOIZDO6NHECA": {
    "2021-11-17T03:52:07.863Z": "download started",
    "2021-11-17T03:52:08.110Z": "downloaded"
  },
  "OIA3DR4KOHCDFFNOELUKGPZAJUIZC7ETZUU4Q6E26YU2R74DHNMA": {
    "2021-11-17T03:53:38.665Z": "download started",
    "2021-11-17T03:53:38.870Z": "downloaded"
  },
  "IBQ7FA2BU6QBSRSEX7QLNYIKNYV3PA3F467CEZARAAV5CQVR3SBA": {
    "2021-11-17T03:53:40.034Z": "download started",
    "2021-11-17T03:53:40.248Z": "downloaded"
  },
  "VNA2Y5ERGDSBSWBS3CCDXQQNSKXAJNGHEFTR56H2YH6CTWG4X25Q": {
    "2021-11-17T04:00:52.130Z": "download started",
    "2021-11-17T04:00:52.369Z": "downloaded"
  },
  "UV2J7C3XWR7RJILEUSAJ2ME7ZFPRB24PG5QYJYOT5TUNSBR43VPA": {
    "2021-11-17T04:09:22.338Z": "download started",
    "2021-11-17T04:09:22.554Z": "downloaded"
  },
  "GEXDZSUL32KD7HCPCJLLZ2ZQOIXNIYVKJGS6QH44UIAWKWBYI6AA": {
    "2021-11-17T04:09:46.688Z": "download started",
    "2021-11-17T04:09:46.902Z": "downloaded"
  },
  "MFM5GBTLMY2WSJHCXSAA3GN3UP4IGOQROQJWMCLBPUL5CGO4PTEQ": {
    "2021-11-17T04:13:19.258Z": "download started",
    "2021-11-17T04:13:19.473Z": "downloaded"
  },
  "SZACIUBNX322PMGSWQEPENCP736JV4BTR5ZYXKZZFNE77WPZQHQQ": {
    "2021-11-17T04:15:25.117Z": "download started",
    "2021-11-17T04:15:25.329Z": "downloaded"
  },
  "TIP23RMCOKFDKO5UK4D2NI5E6OUK5UCRUIM3KKNL2ZMCDQYQXSUA": {
    "2021-11-17T04:15:31.056Z": "download started",
    "2021-11-17T04:15:31.260Z": "downloaded"
  },
  "24W3VPT7PFNIJNG74XIZ4CZUJ3EDEWH54TZL77YGSJ7KRJX3GJGA": {
    "2021-11-17T04:15:34.425Z": "download started",
    "2021-11-17T04:15:34.683Z": "downloaded"
  },
  "2BFRTR2TE7NA3KRMZRQT6BOQNHWFCW2SZXPHA2SSBXJFHG4F3LVA": {
    "2021-11-17T04:19:08.931Z": "download started",
    "2021-11-17T04:19:09.138Z": "downloaded"
  },
  "HW6R36INWEW5I3CA7UYEGISK5JTVBHKAVODDENHN6BCX5DGMEA2A": {
    "2021-11-17T04:21:13.041Z": "download started",
    "2021-11-17T04:21:13.259Z": "downloaded"
  },
  "ERND35LVZIHVMWLPPKERAV2GURCBD3XZLG6ILZJYNCGH52PRP7ZA": {
    "2021-11-17T04:21:15.727Z": "download started",
    "2021-11-17T04:21:15.945Z": "downloaded"
  },
  "Z7E3YSMPKJRG4ZEWXTG56HBVPFHV776UQFE43R35VZ4M63326JNA": {
    "2021-11-17T04:28:58.980Z": "download started",
    "2021-11-17T04:28:59.214Z": "downloaded"
  },
  "EY3MMMZCRJ3L245VDMDV2OX6FN2FO6YD44TOYXYJ3UR7NWH5E5QQ": {
    "2021-11-17T04:30:02.675Z": "download started",
    "2021-11-17T04:30:03.376Z": "downloaded"
  },
  "R5FCLRC7OLAA36TIE64YWKCW5ZU6OCBAGNS2BB5OUD2TPXLQM55A": {
    "2021-11-17T04:37:21.015Z": "download started",
    "2021-11-17T04:37:21.229Z": "downloaded"
  },
  "NHKHMNJ24UOJLX24L75BVHRKH5V5MW5YTTQ6XLCXYT3IAVYATE6Q": {
    "2021-11-17T04:46:59.559Z": "download started",
    "2021-11-17T04:46:59.773Z": "downloaded"
  },
  "NRXCZIMJC7YTGYMLAXSNOLZ3Q3CDVGQFAOYT5CUQKG6NXUXRYXFA": {
    "2021-11-17T04:51:33.362Z": "download started",
    "2021-11-17T04:51:33.564Z": "downloaded"
  },
  "D2MCF4H6FXQCS64FBYGQVVHZUUTAY5PJF4NVMXTQSRKQNLNR5MDQ": {
    "2021-11-17T04:53:11.299Z": "download started",
    "2021-11-17T04:53:11.569Z": "downloaded"
  },
  "UQDHMOSIEBOAVRVBNTBZQAZHTLGEJNNI7G6I2XDGBZFUG2525IXQ": {
    "2021-11-17T05:01:11.930Z": "download started",
    "2021-11-17T05:01:12.142Z": "downloaded"
  },
  "GSARLDF7FHYKT5EBGFMQJONQ7ZMF5SQOVAJIJCVBYZXAZ2GNSUKQ": {
    "2021-11-17T05:01:56.726Z": "download started",
    "2021-11-17T05:01:56.927Z": "downloaded"
  },
  "6OLZIET6DGXIIV6QJEWORDOCDL2ECRGOLOLBGXGMHSVNW7L376RQ": {
    "2021-11-17T05:02:41.584Z": "download started",
    "2021-11-17T05:02:41.797Z": "downloaded"
  },
  "D7FISXJJ24AHCKU7U2UBC3TN6JG4WQN42APSHASMB75K2UTNP5QQ": {
    "2021-11-17T05:03:17.585Z": "download started",
    "2021-11-17T05:03:17.802Z": "downloaded"
  },
  "IO2W3YDGIRA5O2Y76XGSMG7SGC52DFNF7ZGT4A3EZRLM4GAP7HCA": {
    "2021-11-17T05:06:39.208Z": "download started",
    "2021-11-17T05:06:39.404Z": "downloaded"
  },
  "AO6OSV37J4LTSNNKZGFTZU6BWWX5RG4EXPRC4GQVE7235UAH73LA": {
    "2021-11-17T05:09:34.127Z": "download started",
    "2021-11-17T05:09:34.401Z": "downloaded"
  },
  "XJ4CEPETIVDYHLUFY73X663VXJZP7GKJN5YNC6NQPBJ5RAAKBY5Q": {
    "2021-11-17T05:22:51.672Z": "download started",
    "2021-11-17T05:22:51.873Z": "downloaded"
  },
  "GFDNMRQVSPY7OUFIZFBAZV5TC5XEWYK6K7ECDPV4WTS53RVGVKOQ": {
    "2021-11-17T05:25:44.425Z": "download started",
    "2021-11-17T05:25:44.641Z": "downloaded"
  },
  "YJQWDHBXT7GHSBKNC3F3GJ2PKMQC23YZYTGKT7ZH6U2RDKTO7LSA": {
    "2021-11-17T05:29:08.075Z": "download started",
    "2021-11-17T05:29:08.278Z": "downloaded"
  },
  "WUGU5REZOGC3MZG4Q7FXSTAFK6JYFXHXBAT73XTWULIKQO4DUSJA": {
    "2021-11-17T05:29:50.402Z": "download started",
    "2021-11-17T05:29:50.643Z": "downloaded"
  },
  "CSHALLAPWBQOKH5Z6KRCO2J7AF6L7TSZLMNNTPV35YVEYHZF7GZQ": {
    "2021-11-17T05:32:03.899Z": "download started",
    "2021-11-17T05:32:04.106Z": "downloaded"
  },
  "WT5XUDQADI3DYQS3O5EDLR52FXCSKGDSNRRZ6KXQ7SFAE3QS6WCQ": {
    "2021-11-17T05:36:37.303Z": "download started",
    "2021-11-17T05:36:37.522Z": "downloaded"
  },
  "VCO5EOEXPHDFKAHABIJE6Q56ZSIXS57E5SZTWPDKJD3E6KH4O4GQ": {
    "2021-11-17T05:36:47.499Z": "download started",
    "2021-11-17T05:36:47.711Z": "downloaded"
  },
  "4PXBFWBPWV3IWRJLBWB75QKK7GMI563H6QE6VTYDK2NAB5WDAQVQ": {
    "2021-11-17T05:38:43.812Z": "download started",
    "2021-11-17T05:38:44.036Z": "downloaded"
  },
  "7FFARR6MFPJLFI3XKBEVSTFYBHJCFJYRSY73HTKCDONLEC7F25ZQ": {
    "2021-11-17T05:39:24.220Z": "download started",
    "2021-11-17T05:39:24.422Z": "downloaded"
  },
  "RAYMWDHUMEFMQQ4JSZ6KMMLTRX2KIWJF6KWN3URCBTF5YUW7IESQ": {
    "2021-11-17T05:40:26.709Z": "download started",
    "2021-11-17T05:40:26.931Z": "downloaded"
  },
  "H74PLR7SIZB5L4A7XDEP7GY7X3XN7XSXKFCQUGCB725H5FF2UGFQ": {
    "2021-11-17T05:42:08.679Z": "download started",
    "2021-11-17T05:42:08.886Z": "downloaded"
  },
  "Q74EOHPWBLKVZONZLZ3XTSQODEWIW4LLQFTW75XY76RL5QKUBU6A": {
    "2021-11-17T05:42:14.941Z": "download started",
    "2021-11-17T05:42:15.188Z": "downloaded"
  },
  "L3AS7XYVF55BKAJCT5RQAQSF7UMV4T4IVOKOZEJTFI5TDEHZ33BA": {
    "2021-11-17T05:45:44.596Z": "download started",
    "2021-11-17T05:45:44.892Z": "downloaded"
  },
  "RCPG4PALMWLS4A3PO5OQ3MRZ2T7G7PTLZJS7MENKL7ORZVSKDMIA": {
    "2021-11-17T05:47:02.788Z": "download started",
    "2021-11-17T05:47:02.998Z": "downloaded"
  },
  "TDRH62WOA63PAPR6D4BHY7I3JBKF4PQOL5NP6KZQ7TEDQGYK7LIA": {
    "2021-11-17T05:52:52.953Z": "download started",
    "2021-11-17T05:52:53.187Z": "downloaded"
  },
  "NKR7F5YLSB45HHK6XSW5NXR42CIDYFKE5G2PSINUNEIUQYCEX4OQ": {
    "2021-11-17T05:57:25.339Z": "download started",
    "2021-11-17T05:57:25.534Z": "downloaded"
  },
  "NCMQ34SEZSVHTPCG2FGNUERUB5QQ7MSEKESDZT5WEXADHBJKT6JA": {
    "2021-11-17T05:57:43.587Z": "download started",
    "2021-11-17T05:57:43.811Z": "downloaded"
  },
  "NWCWGUUTS26J6UXTIYBHK377E2E4UD7K5AIYKKKHDGHKK6ZWEPRA": {
    "2021-11-17T05:58:36.592Z": "download started",
    "2021-11-17T05:58:36.833Z": "downloaded"
  },
  "FORWIZWHCBXUOE3AHJTGP4J7PT2ZFP75JNUKR46P4QFBRCZF3QBQ": {
    "2021-11-17T05:58:58.527Z": "download started",
    "2021-11-17T05:58:58.745Z": "downloaded"
  },
  "2LQ3JGZPIHVSVDHJDUYY7O732VZIVY3BZUEECUZL25C64H4XGB5Q": {
    "2021-11-17T06:00:26.158Z": "download started",
    "2021-11-17T06:00:26.354Z": "downloaded"
  },
  "EPZTJXUVKRJG4Q627RCJTRJFCD3NURYY2PBBFA7GNJLWJSS7DOAQ": {
    "2021-11-17T06:02:42.210Z": "download started",
    "2021-11-17T06:02:42.419Z": "downloaded"
  },
  "3UHJ7THHVMPAVFZ7GNJ6XFUNUNET5APXSFKEO2T6C3YLBYJW6JAQ": {
    "2021-11-17T06:07:05.634Z": "download started",
    "2021-11-17T06:07:05.851Z": "downloaded"
  },
  "A7MBIGFRCOJ566ZE6HK3JE7H6C32GWYP7LCVDHKB572FPGFOKNWA": {
    "2021-11-17T06:08:37.507Z": "download started",
    "2021-11-17T06:08:37.709Z": "downloaded"
  },
  "VZHZ5ACM2I5BASTV7IAONVZ4AHPOP7EQXTJZLA3E4BIZWG5LR44Q": {
    "2021-11-17T06:09:21.419Z": "download started",
    "2021-11-17T06:09:21.631Z": "downloaded"
  },
  "LJIQN3NDB7R3ZZRA3HLMJ5EOFSUD4N4LFT4SUOLA7LVODWNAHWSQ": {
    "2021-11-17T06:11:21.580Z": "download started",
    "2021-11-17T06:11:21.778Z": "downloaded"
  },
  "Q4BKUNYM3LENW5RKYNLPAU6SJLO7JHOI4GFJWUVI746DAZAQKRPA": {
    "2021-11-17T06:12:03.083Z": "download started",
    "2021-11-17T06:12:03.298Z": "downloaded"
  },
  "MYVW6AJV7FBCJ7DS5NPZAKRKFABKAXA5ZDMPPFHOVAKJTUVZRJPQ": {
    "2021-11-17T06:16:06.128Z": "download started",
    "2021-11-17T06:16:06.413Z": "downloaded"
  },
  "5QTTKAN75ZTJ7AD4LJ4MNGELQZIWFKB3OO7JNBVPSNKD2KNTEXKQ": {
    "2021-11-17T06:25:04.574Z": "download started",
    "2021-11-17T06:25:04.795Z": "downloaded"
  },
  "IXBHK7JZQEE53ITJ33C42LFPLDHBKU6VSCYNQJIFP73U7SG2EHCA": {
    "2021-11-17T06:25:30.267Z": "download started",
    "2021-11-17T06:25:30.510Z": "downloaded"
  },
  "PDQG2IJX3QZMDSQRD7FRBWU753ZSEEADAUJGOI3XMPGNZ3OMEEUQ": {
    "2021-11-17T06:26:45.492Z": "download started",
    "2021-11-17T06:26:45.714Z": "downloaded"
  },
  "ZNWKHMFNOU4J6RNMM44U5O36DBPCKRIJCW5PLUKNZEYNVT7ZKO6A": {
    "2021-11-17T06:32:02.580Z": "download started",
    "2021-11-17T06:32:02.790Z": "downloaded"
  },
  "B2WL7LG2BV26RGF2FK7NX4YGF3EBKTENQCB2BF76KH5VHZDUZFEA": {
    "2021-11-17T06:32:06.486Z": "download started",
    "2021-11-17T06:32:06.676Z": "downloaded"
  },
  "AGROIGJH6767W2SYVDUUFKAJGYAZO5ICJNJZE4DELJO5BAJ5CXXA": {
    "2021-11-17T06:37:55.442Z": "download started",
    "2021-11-17T06:37:55.669Z": "downloaded"
  },
  "SLDD3QUXUDQBTHWSH5YYKU7W4WY4HT7DVHLTEPJ5OF4IMFKYY22Q": {
    "2021-11-17T06:38:45.387Z": "download started",
    "2021-11-17T06:38:45.572Z": "downloaded"
  },
  "4NN65I5KZTJG45KGK5X2YAMPGHLGQFDEJCGTKFTYVIIWYJYEW2VA": {
    "2021-11-17T06:41:58.992Z": "download started",
    "2021-11-17T06:41:59.210Z": "downloaded"
  },
  "P4SNZIUQU2VW2KKHU7IFSPOHKGXBBLLQGLZCXJM74SQ3XUNNGOHA": {
    "2021-11-17T06:42:03.037Z": "download started",
    "2021-11-17T06:42:03.261Z": "downloaded"
  },
  "OJKFCSLU32GITQEKCR43Z57EM4F6OUT2NISN2XGJK2K6MIAZ5DMQ": {
    "2021-11-17T06:42:09.443Z": "download started",
    "2021-11-17T06:42:09.647Z": "downloaded"
  },
  "K2VGHENGUMC7ENHHVXKS6JS2XITAIACGIRK4DUNMBCOLEFSZKG7A": {
    "2021-11-17T06:43:22.759Z": "download started",
    "2021-11-17T06:43:22.967Z": "downloaded"
  },
  "KAC6YQOQYXANULLVIQHZ6ZAGVDSOBBRR7DWNMANUSGBW2DSP6I4Q": {
    "2021-11-17T06:48:33.436Z": "download started",
    "2021-11-17T06:48:33.684Z": "downloaded"
  },
  "X2VIUZF2E6IUWTRMWPP5QJS5GYLHCXK2URWHUHEWSQK6G4G247UA": {
    "2021-11-17T06:50:55.494Z": "download started",
    "2021-11-17T06:50:55.688Z": "downloaded"
  },
  "HT4OECVRJWMSB5PTC6Z3CX6VNT5TCXNC3V6OCZUWD3TXQB6ANQNQ": {
    "2021-11-17T06:51:19.372Z": "download started",
    "2021-11-17T06:51:19.586Z": "downloaded"
  },
  "7DY4OFVW5EMM6QQ7ES5IVJGWF254VWMVMPVDED5YIWOLYPVCTDTQ": {
    "2021-11-17T06:54:53.381Z": "download started",
    "2021-11-17T06:54:53.589Z": "downloaded"
  },
  "Y6JZ43OVI4ZSPW4ADPUITKIFFJK3477DOGCPKC5754YECDTEQPLQ": {
    "2021-11-17T06:55:37.416Z": "download started",
    "2021-11-17T06:55:37.633Z": "downloaded"
  },
  "LHZRZW5GVFELSUNM4FZDYAQHGJ3V7BRCYLPBGXQWK3W3TLUQJU2A": {
    "2021-11-17T06:55:39.421Z": "download started",
    "2021-11-17T06:55:39.627Z": "downloaded"
  },
  "IZRNRA6FJRA6JCKECTJG4X2UY5LUL5Z2B4TBZIPJATRGYHILZEMA": {
    "2021-11-17T07:11:23.272Z": "download started",
    "2021-11-17T07:11:23.464Z": "downloaded"
  },
  "5W66IIPD7SHSYG6PRKSEKBJFRGZYJO7HTNEW2AGDPNPXSLWSACEA": {
    "2021-11-17T07:11:45.708Z": "download started",
    "2021-11-17T07:11:45.917Z": "downloaded"
  },
  "EI3I3ABI62HNYDIPOO4Z2AUQQA5XSQ5WI5XHJNXOQV5KDCNWMDPA": {
    "2021-11-17T07:11:46.684Z": "download started",
    "2021-11-17T07:11:46.933Z": "downloaded"
  },
  "JZU4XCSPKZA2XO6YFF3ERSXYNE43SPNEITR5R3VNA4QUQPU4QTZQ": {
    "2021-11-17T07:14:50.276Z": "download started",
    "2021-11-17T07:14:50.478Z": "downloaded"
  },
  "64P4UFIAX6CBVLL55J26L4PKB4PWQHNHEQXGBTAW2QB4T6XLMFAA": {
    "2021-11-17T07:15:02.348Z": "download started",
    "2021-11-17T07:15:02.557Z": "downloaded"
  },
  "YH2V7ISNLVQEJSWX5QIDAGFNBTAF4EXA3OGCB4D2QDCL6UUJ6LOA": {
    "2021-11-17T07:16:18.352Z": "download started",
    "2021-11-17T07:16:18.568Z": "downloaded"
  },
  "QJ6SL7H6EAVT4RWSBUCEABMFVW37COSRKCHUHOQAPKQHT4SDZ45Q": {
    "2021-11-17T07:27:09.253Z": "download started",
    "2021-11-17T07:27:09.507Z": "downloaded"
  },
  "EEGRNBESCO7AGZQEMZV3KTJVRWWZK7KISG6ZVBBFEABQV3TDFI3Q": {
    "2021-11-17T07:27:40.359Z": "download started",
    "2021-11-17T07:27:40.597Z": "downloaded"
  },
  "PZ43F5TF2CUF2RK45MG6W3ED7C7GINF7YS42BC2TPFXBDS4K4YRA": {
    "2021-11-17T07:28:46.881Z": "download started",
    "2021-11-17T07:28:47.126Z": "downloaded"
  },
  "FVIHHRTP673KVQ74HEZGUEPMAROPIB7KUG2XHJTHSZJST2F3ZHLA": {
    "2021-11-17T07:28:49.828Z": "download started",
    "2021-11-17T07:28:50.035Z": "downloaded"
  },
  "SR62IQCPHNCFZGDHJV4TMNLX7YYLLSV64SULLX2WULB6RUFUXK5Q": {
    "2021-11-17T07:33:28.551Z": "download started",
    "2021-11-17T07:33:28.815Z": "downloaded"
  },
  "OD3JFWIWZU5XR5LCDHUCK5I3WF4ONXGSNBZMDVQLGH6NEFYJXM4Q": {
    "2021-11-17T07:39:01.794Z": "download started",
    "2021-11-17T07:39:02.011Z": "downloaded"
  },
  "IVYH6MZCMPGXQ53OWELMQREZKNE3SAFMLZLZUZ4PUXDNSUCZCHHA": {
    "2021-11-17T07:40:08.786Z": "download started",
    "2021-11-17T07:40:08.997Z": "downloaded"
  },
  "ATRKRYUJXQF2M6YV2Z2AAY5CAEWWWVRZAW6VVS6BXO5YISYOOVXQ": {
    "2021-11-17T07:46:03.564Z": "download started",
    "2021-11-17T07:46:03.768Z": "downloaded"
  },
  "XOECSTNU47C5HKYRKNASNQ6QWAQAI3O5OSDVQEVYGE242KGFTSFQ": {
    "2021-11-17T07:47:26.765Z": "download started",
    "2021-11-17T07:47:27.051Z": "downloaded"
  },
  "2LBIY46TRPQOVTQHVDI6UUGZNJFX6MAZYSC65CHVO4HW5MKRJ3VA": {
    "2021-11-17T07:47:43.849Z": "download started",
    "2021-11-17T07:47:44.053Z": "downloaded"
  },
  "UL7FWYD4KBWPOGCMQYSDMNVDAKF7KC3PBZBOVFA7BNDO7MNWRFDA": {
    "2021-11-17T07:48:47.032Z": "download started",
    "2021-11-17T07:48:47.261Z": "downloaded"
  },
  "VWN3PAAPM5Q7Q5D3Q3UVH7IFRMC2ZZUZ75BFBTEGJSLZ3ZE2YEMA": {
    "2021-11-17T07:49:09.645Z": "download started",
    "2021-11-17T07:49:09.851Z": "downloaded"
  },
  "Z2WDDFZB3EN2XCOXFHUK67HEPNWQ2MAPV3IO5QVALCPTXWVOM25A": {
    "2021-11-17T07:49:44.226Z": "download started",
    "2021-11-17T07:49:44.441Z": "downloaded"
  },
  "LDPQ2S5KUGSSVTSZUITM65X3HRMQPLZX7K5BNQ5PQ2O3GWC2M3DQ": {
    "2021-11-17T07:49:49.415Z": "download started",
    "2021-11-17T07:49:49.636Z": "downloaded"
  },
  "WUAVNYKBEIXQURYZQV6XHSXRTI3GSPL6BF2KUN742QAFMBRUP4DQ": {
    "2021-11-17T07:52:36.101Z": "download started",
    "2021-11-17T07:52:36.333Z": "downloaded"
  },
  "OULS2YWAW5P6YAIOG26UVXCG6IJIFZLVF7WY5FFY6QNHSHQMUWIA": {
    "2021-11-17T07:55:28.717Z": "download started",
    "2021-11-17T07:55:28.941Z": "downloaded"
  },
  "SO7KD3OOZ5OMXM23AO5FO2C3ALRZRDOJSTKV2Z3LQUPADMV44Y2A": {
    "2021-11-17T07:57:10.556Z": "download started",
    "2021-11-17T07:57:10.771Z": "downloaded"
  },
  "QPBLWN77VVAB427LQQKIVD2M4UUVB455T3347I7LBVZWHCR4WACA": {
    "2021-11-17T08:06:20.600Z": "download started",
    "2021-11-17T08:06:20.861Z": "downloaded"
  },
  "VVDZGSUJ23L6AR3BXKEEV6Q4VJWMUCMKVKAJ3XJQSXQ63A4ODQIA": {
    "2021-11-17T08:17:26.168Z": "download started",
    "2021-11-17T08:17:26.458Z": "downloaded"
  },
  "5N5O7DNU3QIU34GKBAJ44QHA33BVYODKVBXJBPZ4GIIZCJ6CRNMQ": {
    "2021-11-17T08:19:02.583Z": "download started",
    "2021-11-17T08:19:02.796Z": "downloaded"
  },
  "2EBWWR7ES7KBPBZA2KERHQ3N6DTVYEZ2RZJXOPZ2KBXYQSXLJCGA": {
    "2021-11-17T08:19:06.797Z": "download started",
    "2021-11-17T08:19:07.018Z": "downloaded"
  },
  "3O4KPDIWL4VTPK2W6AYHIIE57AHWJWKAI4UGU56OQD4T3FZ245EA": {
    "2021-11-17T08:28:51.626Z": "download started",
    "2021-11-17T08:28:51.871Z": "downloaded"
  },
  "C6SFJA64T7QQHFIWPKEG2F5LHBUISX27Y5YT7G672ZGYYLRGRWJQ": {
    "2021-11-17T08:29:29.684Z": "download started",
    "2021-11-17T08:29:29.900Z": "downloaded"
  },
  "TWTENR3M62F6JYPR3KW6TK7Z2LEPSYLWH4IVDKJTQ752PE6XQBOA": {
    "2021-11-17T08:30:00.494Z": "download started",
    "2021-11-17T08:30:00.717Z": "downloaded"
  },
  "W3Y3GNQSQY4LWY6TGYPDIQMCK7W43EHDPTUYGPIHULJPMVOJ5EOA": {
    "2021-11-17T08:32:20.841Z": "download started",
    "2021-11-17T08:32:21.067Z": "downloaded"
  },
  "73H3NT7JVHIPD2HAYQ42MGX5EKP2D6RCVUUFXCPDA2PGM3T2JRKQ": {
    "2021-11-17T08:34:54.577Z": "download started",
    "2021-11-17T08:34:54.770Z": "downloaded"
  },
  "57U4WYP5PXALXWOH5YP26XYTSX6XLQSZ3SBGIIW7YI5HPUSWM5TA": {
    "2021-11-17T08:50:55.307Z": "download started",
    "2021-11-17T08:50:55.507Z": "downloaded"
  },
  "4PCIYPWZDODVOWF4WKZS33NWIEI7VAJLOOUUQNO77KNR6VKJQHTQ": {
    "2021-11-17T08:51:58.809Z": "download started",
    "2021-11-17T08:51:59.176Z": "downloaded"
  },
  "UZGVCZUTPABQEJNRV33PGRONR2ACWCXPFTEY4ZYUJYGJG43RUPLA": {
    "2021-11-17T08:54:59.466Z": "download started",
    "2021-11-17T08:54:59.696Z": "downloaded"
  },
  "KO3FMXN2GLCO7AF337OCSGLKWZAYTMGJCTMZSUEI6NIS64RHORKA": {
    "2021-11-17T09:00:58.158Z": "download started",
    "2021-11-17T09:00:58.397Z": "downloaded"
  },
  "T5QDV3ZK4OFDVBNYQANYDCQYZGVBB6WH3I5YUSNKHCLSYCFE2JIA": {
    "2021-11-17T09:02:37.282Z": "download started",
    "2021-11-17T09:02:37.512Z": "downloaded"
  },
  "D2TYEUNWJZNNF6JLPTMHC2X2BAOFHP3EIFH4EKWYESCSMLH34ZBQ": {
    "2021-11-17T09:03:18.651Z": "download started",
    "2021-11-17T09:03:18.857Z": "downloaded"
  },
  "IUGITPDJZNT5NKC5CGZNYD5SONGXMZQEMALZ63FC2XRKR7TWPRCQ": {
    "2021-11-17T09:18:26.953Z": "download started",
    "2021-11-17T09:18:27.174Z": "downloaded"
  },
  "J6FDYRM25DZDKMGUVGMTUMEFVWWL5BJBSQQMYQBQFVMLH4JTYO3Q": {
    "2021-11-17T09:20:33.087Z": "download started",
    "2021-11-17T09:20:33.294Z": "downloaded"
  },
  "5XUC6AACRYGVYTYVYVNVLID7ISZORBQNSKMGB4C6OM7LB7BRKYSQ": {
    "2021-11-17T09:23:01.405Z": "download started",
    "2021-11-17T09:23:01.608Z": "downloaded"
  },
  "H2N3PUNTUFO76NBFYWRPSFLTI45FXXBL7TYY7DNJWFI4YK524FEA": {
    "2021-11-17T09:29:03.562Z": "download started",
    "2021-11-17T09:29:03.783Z": "downloaded"
  },
  "5FW44EUABI4QW26S5B47GGEPXEA4OBE6Z5RKUDPT5M5GQZBVHYFA": {
    "2021-11-17T09:32:43.562Z": "download started",
    "2021-11-17T09:32:43.767Z": "downloaded"
  },
  "F2IEQ4K6JQG3QA6OUFHFM7367HEGMDSBXOCAMFBER6QSH75K26AQ": {
    "2021-11-17T09:42:50.138Z": "download started",
    "2021-11-17T09:42:50.355Z": "downloaded"
  },
  "4BXPWIYAK5HRY6FKM43JYTZ6XCIHAHOI2S7W6DP5G4NZJQSYPITA": {
    "2021-11-17T09:50:37.113Z": "download started",
    "2021-11-17T09:50:37.344Z": "downloaded"
  },
  "XYWR6LH7KBUNVAMLJUMNSSDESNDP3DC5MTJ6HQKL2IWAFUDC6ZSQ": {
    "2021-11-17T09:54:56.401Z": "download started",
    "2021-11-17T09:54:56.610Z": "downloaded"
  },
  "ZVM23NH5P2RX37XFB7KCXU3RVSKCXDFOH3D3EGDW3UXLWAHGNRRQ": {
    "2021-11-17T09:59:08.886Z": "download started",
    "2021-11-17T09:59:09.165Z": "downloaded"
  },
  "U3INLFE2THRFJ7D3ZYMIS7VB22FLRDAAA2L2DVPZWYSVULCMNBLA": {
    "2021-11-17T10:01:25.678Z": "download started",
    "2021-11-17T10:01:25.884Z": "downloaded"
  },
  "XVUQOS3WB536IUWCQGXO5FCJT4NUSOQ453BOPFGKO7C3QOX6YVXQ": {
    "2021-11-17T10:04:47.954Z": "download started",
    "2021-11-17T10:04:48.168Z": "downloaded"
  },
  "DR53MGB4MFAPEWU4CPVFN3KGR647L3KPERNA7HORYDEYC534Y7RA": {
    "2021-11-17T10:07:00.181Z": "download started",
    "2021-11-17T10:07:00.439Z": "downloaded"
  },
  "4SGQDLGCUDYDVUIP2YQQLH4GB2RNDWTO5RSRKCXIQSXBU3I7TYBQ": {
    "2021-11-17T10:27:48.517Z": "download started",
    "2021-11-17T10:27:48.729Z": "downloaded"
  },
  "L7SQMKVFFBYB67MKP647I7RTYL6KC35WBNCUJN2GYNDXIADRLQIA": {
    "2021-11-17T10:28:32.395Z": "download started",
    "2021-11-17T10:28:32.604Z": "downloaded"
  },
  "5DBGJS7FWEVDW45NF6LOWUZRXL7EJNE67ZWRY2WCC63CPHVF6XCA": {
    "2021-11-17T10:37:13.593Z": "download started",
    "2021-11-17T10:37:13.829Z": "downloaded"
  },
  "NOSAVJ624JKT274PFKVY5YQA43UG7ASZB547YA7NV2I76PBAR3OQ": {
    "2021-11-17T10:38:44.679Z": "download started",
    "2021-11-17T10:38:44.919Z": "downloaded"
  },
  "LARJFVFDCLHQFZEMACP2QB6ACNSSFZN6BQMPKCVAMN3V3XPJU7SA": {
    "2021-11-17T10:40:21.821Z": "download started",
    "2021-11-17T10:40:22.027Z": "downloaded"
  },
  "NTYTV6PBXEZ3JMOCHJDOYGSCLMIJDIXEKVW3RLSWBNFPVYCINT2A": {
    "2021-11-17T10:43:35.665Z": "download started",
    "2021-11-17T10:43:35.864Z": "downloaded"
  },
  "T72ERKUIYCWGQO7WGSIPA37R76RGVEJ66MBGQRRKNE4P4ZQUM24A": {
    "2021-11-17T10:49:25.483Z": "download started",
    "2021-11-17T10:49:25.693Z": "downloaded"
  },
  "CROZ4PUOA66ZHOI7347APYKC7HS3ZM35N4WU74ZWQNRRB6SFEXWQ": {
    "2021-11-17T11:00:05.156Z": "download started",
    "2021-11-17T11:00:05.387Z": "downloaded"
  },
  "64UTS32ONY7XBIADDHOF5OLNUGQPHZI2KQW2X6DHA5JGOEGHCWNA": {
    "2021-11-17T11:03:18.395Z": "download started",
    "2021-11-17T11:03:18.636Z": "downloaded"
  },
  "E224VJIGKAJKL4Z32HBCVVYBXDSZ23TGC3B43ESC4JRAPCFSQ7DA": {
    "2021-11-17T11:09:21.853Z": "download started",
    "2021-11-17T11:09:22.063Z": "downloaded"
  },
  "SAVJG7ZMUVY6K4W7EX3J5JW2PFXI3CACBBM7QOS26Z7RGNOFSDYQ": {
    "2021-11-17T11:11:15.076Z": "download started",
    "2021-11-17T11:11:15.323Z": "downloaded"
  },
  "Z75JDMEMJNM7PXVCMEOJ7UT3SAGW77YR3BLCA2POYY7ADWIBXVEA": {
    "2021-11-17T11:11:58.612Z": "download started",
    "2021-11-17T11:11:58.878Z": "downloaded"
  },
  "ONWDYYYICFPTEHZEFW2KUDSOR3WG2YW3YZW5K4S7LUHJYG3IPLTA": {
    "2021-11-17T11:12:24.706Z": "download started",
    "2021-11-17T11:12:24.906Z": "downloaded"
  },
  "7X3IPMWHPMLBFKSPGBAPSTADYV6VYCWQ5HBLKROI4R5L3TO5ZUQQ": {
    "2021-11-17T11:20:47.896Z": "download started",
    "2021-11-17T11:20:48.111Z": "downloaded"
  },
  "XNE2VIDAYETYP6TPWUKF2EARHRA43FPIRMEAGZPTAOF5HAPNHUAA": {
    "2021-11-17T11:20:56.739Z": "download started",
    "2021-11-17T11:20:57.031Z": "downloaded"
  },
  "FNRO5IG35AUWYJJXHKOLJ2J64EORIAXSSBKXS5FM6KEO6UEUV63A": {
    "2021-11-17T11:21:52.003Z": "download started",
    "2021-11-17T11:21:52.218Z": "downloaded"
  },
  "YGMCNFUUCGZWKD6LDKISGMV22KHEUEM2ZKZOYTUOACMBDFREYLGA": {
    "2021-11-17T11:21:54.707Z": "download started",
    "2021-11-17T11:21:54.921Z": "downloaded"
  },
  "JJ5KOAPUAKAKGCJDXVC5K7TZQXLTX4DIGO4NGBQ5RRK3XEYSVUMQ": {
    "2021-11-17T11:22:45.372Z": "download started",
    "2021-11-17T11:22:45.573Z": "downloaded"
  },
  "QU3H72XCCGWTFFCFS2M47NGFHLNGHFNVU6H4V5HIA5LTYD54CNPA": {
    "2021-11-17T11:24:30.747Z": "download started",
    "2021-11-17T11:24:30.966Z": "downloaded"
  },
  "2VZ5RCESZSTLRQUSILNYHVMZUIAPMJTEKQ73EEKYOMOPXWWO6H6Q": {
    "2021-11-17T11:31:18.439Z": "download started",
    "2021-11-17T11:31:18.692Z": "downloaded"
  },
  "EN7DZKBULGHHABAN2CFQPS4VHRDBDCWHPI22EZN4KV4DMKISH6KQ": {
    "2021-11-17T11:32:31.657Z": "download started",
    "2021-11-17T11:32:31.865Z": "downloaded"
  }
}

avg seems still be like 200-300ms found one that is 800ms and one or two that is 400-500ms

49

Last error of this type in my logs was in November 22. Did you manage to fix it or is my node just lucky to not encounter these errors?

1 Like
50

Devs should have stopped the faulty worker. It may be turned on again to gather more information as to why it is not working as expected with the same software and configurations as others.
More like a hardware issue, but investigation is still in progress.

2 Likes