Hi, my previous macmini 2011 suddendly died, and I need to substitute it, so I thought to buy the new M1, but I can’t start the proper image (I think) resulting in suspensions.
Nor can I start the watchtower in ARM mode (instead of AMD)
Can you please help me achieving this?
Many thanks in advance, Nicola Lomartire
Hi @evanmac , I’ve forwarded your question to the team for some answers.
Hi @evanmac
Would you mind running this command and reporting the output?
docker logs --tail 50 <storagenode container ID>
If there happens to be any identifying info: email, wallet address, etc you can omit that
this:
$ docker logs --tail 50 <storagenode e3336b575f3f>
-bash: syntax error near unexpected token `newline’
Please, remove < and >, they are part of the placeholder <storagenode container ID>
I think it should be either
docker logs --tail 50 storagenode
or
docker logs --tail 50 e3336b575f3f
sorry for the mistake, here it is:
$ docker logs --tail 50 e3336b575f3f
2021-11-09T20:20:12.007Z INFO piecestore upload started {“Piece ID”: “3DBEOJWVJE6EZX4YXZREEZXUWYBQKLNAKQ2PRA57DRKPOZ4WOTIA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:12.646Z INFO piecestore upload started {“Piece ID”: “ZZ3X4Y66S43ADEGSAE6SMF6S7BX5AL4AETZBBBA7XJBDZ5I7B33A”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:12.901Z INFO piecestore upload started {“Piece ID”: “UZ2E5ZX4L5AGFZO5BJYMMZCX3QCXKNSBUK2DW6PHOWZDGS3JMZHQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:14.884Z INFO piecestore upload started {“Piece ID”: “M5ZTHJG7ZKQ7KPAJJEWUM7FF6TJ37FXQICSSHWT3ZXAZ2FRBWE2A”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:18.070Z INFO piecestore upload started {“Piece ID”: “GV45JG6KET5NZ6WMLPGVTLNLDMM4SNA3KARMBGWUJDL7OA5KU2MQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:20.794Z INFO piecestore upload started {“Piece ID”: “BALPIFJKZBGQXDITTFKZXDE2Q4KUBC4FW4G3HYSS5FEP3NAZEB2A”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:20.794Z INFO piecestore upload started {“Piece ID”: “HNHO2ASWGPQYON56Z56AX42UCALMO5UWTRN43MDBSSUZ45V47SOQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:21.368Z INFO piecestore download started {“Piece ID”: “3YA3VGPF4D5FMXEA4U4WPJDJQWZJ2NOX6AV26FVWF7K7PTQ4U7FA”, “Satellite ID”: “1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE”, “Action”: “GET”}
2021-11-09T20:20:21.384Z INFO piecestore upload started {“Piece ID”: “3NMQUJZSTLL5TSEE5ZHJBNFAF5R34HALQNSGJOT76HMHUDM6ZBDQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:21.538Z INFO piecestore upload started {“Piece ID”: “IJOIFSE7J7H7J3YX7OP2LDDL4YRNV4AP6C2LTB6KNKISQUPZ3GVA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:23.623Z INFO piecestore upload started {“Piece ID”: “3WFNWR5K4EPTZ4C5IEKRI4WZTPJT5Y5EEUOIG4NK4DKXQ3NIIJKA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:23.624Z INFO piecestore upload started {“Piece ID”: “BIKDNH3EA4NI7K5W7KX3IGBLHRY6PDBMPGBYOSRALO4Q4OT7D4WA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:23.624Z INFO piecestore upload started {“Piece ID”: “GCWX3UYGD2SUYAO7U7WYFIC2F3JKQAGYTQIRGNJUOSTMK7JTWHSA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:26.612Z INFO piecestore upload started {“Piece ID”: “NM6LJ3YKFY6EZSDDFFVCV2GFHWPBGYFWHZVV2C4HDMMKXK6WMVPQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:26.654Z INFO piecestore upload started {“Piece ID”: “S36YJBBAM4MXYP576HOAIYF2JUSXZFJ7RTJA7OV6S6XIYM6HOMUA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:28.301Z INFO piecestore download started {“Piece ID”: “L5RCR2NGAKQNLMGJ4PKIG3D4Q7XZP3GLSV6C2LNZUOI6TXP6KYYQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”}
2021-11-09T20:20:29.145Z INFO piecestore upload started {“Piece ID”: “5JUJMXOLQSZTKGOLIVETXFMZLY6LGI5H4JANXANY6KDXEHJT6GIQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:29.151Z INFO piecestore upload started {“Piece ID”: “2AWJ5G45IQQ2EKJAEBQ7BLP6KDWY5WIR6LRKYKSAI7LZNFQSAYZQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:29.470Z INFO piecestore upload started {“Piece ID”: “UDOIEDKZASQQEYZNYDKBCVT5NYFQBPKP4ROC7WNXMCRPE34ZADSQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:30.700Z INFO piecestore upload started {“Piece ID”: “4OKHG6CZZK5JZT3MBF6UBUNJWS4EKGZSCQDXCSQVTDZLJ6QVZOPQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:31.059Z INFO piecestore upload started {“Piece ID”: “K5B7IJ4MTRNGR64MH37FSGXYXAMYJ6CLZ2FHZBGSVQZJPXEY5JHQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:31.181Z INFO piecestore upload started {“Piece ID”: “5KSNMV3ORTWJKZOZJM2YSRZTH3TH5DBF2OERCKERUTXQF2L3YB3A”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:31.775Z INFO piecestore upload started {“Piece ID”: “2CHHE3FQHVNZUHKGM56ANH3L7HMIRMHPMYKJHCYJLT5HPKM7VGFQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:35.209Z INFO piecestore upload started {“Piece ID”: “AEDE5DPN7ZPIUZ6KYO2G6VZLUNR772L5FMOVOG474JREASCLTOVA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:35.786Z INFO piecestore upload started {“Piece ID”: “L7OFMAGMRYW5ORNVKHQLIW2UJRLCR5HCYNRACNDYGDAGWV3L5ZVA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:35.930Z INFO piecestore download started {“Piece ID”: “3YA3VGPF4D5FMXEA4U4WPJDJQWZJ2NOX6AV26FVWF7K7PTQ4U7FA”, “Satellite ID”: “1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE”, “Action”: “GET”}
2021-11-09T20:20:36.117Z INFO piecestore upload started {“Piece ID”: “XXYRXWYB67GSGOEUWVQSLKLRWAQKE3V6ACI3S3XDK5JFKNGXCCOA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:36.281Z INFO piecestore upload started {“Piece ID”: “HYKQRBM2EUDYYWYPYWIBSO7BDCM7ZVJMKI5RTVZ2YTXNWORCV6MQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:37.652Z INFO piecestore upload started {“Piece ID”: “AR34UVGW6HQISXCF64URLLLHXR27SOYHFZQJWJ5C3HKBNKL5PVIA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:38.616Z INFO piecestore upload started {“Piece ID”: “E53263BVN5LDMXXS6BDUZFFQNPMQA3MQRXPRNPC3IJR2Q2WDLRWA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:38.677Z INFO piecestore upload started {“Piece ID”: “JWRDMQLE7BV6LHMLX6WUOYU2YLO2YC7WGPMHEYHAQDIQ4LBIZKHA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:39.443Z INFO piecestore upload started {“Piece ID”: “NUYUNHT27K3XGUEAZFQYYWUYYBM6P4MSPVSN4VNUK4A4C3K4MQEA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:40.277Z INFO piecestore upload started {“Piece ID”: “XEM2MHPGDKKYE7PY57PTTA344EHF75QAJAAKMPRM2GZVK247X3PA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:40.808Z INFO piecestore upload started {“Piece ID”: “QAHANFT4HR3SGFNGRZWUVHRD2QMAWAFBJG5FUBQ44MON4XI3S4YA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:42.524Z INFO piecestore upload started {“Piece ID”: “SFEGCUMHZ4EE23V3RX5K66MIAIR26MJILOJBQCYNUN2I6LNFDFCA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:43.082Z INFO piecestore upload started {“Piece ID”: “DBF7I66TVBWIW2GHAWN44ANHZJ3PCO3EUDSG47UY3GKH434SFRRQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:44.128Z INFO piecestore upload started {“Piece ID”: “GTHABJXKJXHT3ELFJYNS65LVWHN2KGAJOOOUJNZDHV7PI2AURPHA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:44.307Z INFO piecestore upload started {“Piece ID”: “XI6UFTZ6D4M5XQ6QRJ7LS3OBOA7XOD6TRILQU7MTVOJIOFWGGA2A”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:45.359Z INFO piecestore upload started {“Piece ID”: “WLBWGHDD6UHEWCOWXFENLS4QFNVZOPKGNJVOEQAS7TAVKBGG34SQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:45.560Z INFO piecestore upload started {“Piece ID”: “3XJF5ZVWUF7UMYCSYETTM7RIDHJ54SGDTH57IM6VN6KGGUCZSF3Q”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:45.839Z INFO piecestore upload started {“Piece ID”: “CUBQJLWQK5V7CTTGUPTDSZ5YWLPLF3L6IQPJ6IU4BGYGDY77ZV5A”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:46.302Z INFO piecestore upload started {“Piece ID”: “SZFB45KCOAGU6TEIYHPH7KYAGLSLABAL6GY7XR3MYADFVOK5RGVA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:46.344Z INFO piecestore upload started {“Piece ID”: “SSUJMZWJXUKKWEVDHUW4MRQT2AH6WZNQBMXQURJECAXTHI4U5OPA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:46.438Z INFO piecestore upload started {“Piece ID”: “W5C7CXB76ELSCZU57SLFFWT3AGENP4GCY2O6USLIGDWOEWRXG3JQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:46.641Z INFO piecestore upload started {“Piece ID”: “FNFVKPLWSS6PVV3PBT2B4D5S5VBAKIR3IGYK4G5ZCZDLX22EAMRA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:47.092Z INFO piecestore upload started {“Piece ID”: “CVIJPZK3NDHZS3EX42A77COTMMZOHQIXDZMX2MQONSVXKZZI5AYQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:47.725Z INFO piecestore upload started {“Piece ID”: “R74XCSY7V37LZ3ZQTZ5KBWS3ZVKD22G5QE7DJAN42E7VW4F7JUJQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:48.774Z INFO piecestore upload started {“Piece ID”: “23LHQT5F4UIHH27UBC3NWQMO5EIJFSV544LVPJX7X524DFBTLJNQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:49.295Z INFO piecestore upload started {“Piece ID”: “Z5YA3RDR3S6FZREY3FP5MSXJXHHH6AB7XYYEMFOILCAU56JTNPFQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:20:49.393Z INFO piecestore upload started {“Piece ID”: “YLSB4FXJ7HTDQVJ7SY7X7HDJO42KKT6KCH3DLKVFKVE5AHMQQEXA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
now slightly changed:
$ docker logs --tail 50 e3336b575f3f
2021-11-09T20:26:32.452Z INFO piecestore upload started {“Piece ID”: “BOFQRDAZZ2FJ7B7E5TFIK2RHWC2M66BJZW2F2WSOOAQURUEQ2BEQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:26:32.893Z INFO piecestore upload started {“Piece ID”: “ZVN44AF3Y52RZ73R7OQLGFU7A5OOKXMNK2F6FQBFTUGS2JRBKPMQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:26:32.913Z INFO piecestore upload started {“Piece ID”: “WF7CTMDDX77AWRIOAMKV4G5PMJRMDZKHQUGYCOE7EUN25HGXTCDA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:26:37.297Z INFO piecestore download started {“Piece ID”: “LLTSIBX6EBCKTUMALJWHNZXGZMDR7ZK6X3PWE6AHRHY44NET2LOA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET_REPAIR”}
2021-11-09T20:26:39.569Z INFO piecestore upload started {“Piece ID”: “IUJB5PGEQBEFG4FUF4KU5AB5NQYZRMLUFOG7TXL4LTJFFIH32XZA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:26:39.570Z INFO piecestore upload started {“Piece ID”: “HRIF47FWCZCGTW3PHV2675HOFUNUBRFIXQHTP7ZRIIN4FMASZWHQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:26:39.570Z INFO piecestore upload started {“Piece ID”: “36WDLX222WJ7HORRXLTEJ4VFAUWAAKJU7LY46DDAFA4PRUQKGXTA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:26:44.777Z INFO Got a signal from the OS: “terminated”
2021-11-09T20:26:44.922Z ERROR pieces:trash emptying trash failed {“error”: “pieces error: filestore error: context canceled”, “errorVerbose”: “pieces error: filestore error: context canceled\n\tstorj.io/storj/storage/filestore.(*blobStore).EmptyTrash:154\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).EmptyTrash:310\n\tstorj.io/storj/storagenode/pieces.(*Store).EmptyTrash:367\n\tstorj.io/storj/storagenode/pieces.(*TrashChore).Run.func1:51\n\tstorj.io/common/sync2.(*Cycle).Run:92\n\tstorj.io/common/sync2.(*Cycle).Start.func1:71\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-09T20:26:45.747Z INFO piecestore upload started {“Piece ID”: “DECYWYDLL5D7TTLNBQJISEVVL6XHJYQXVDDHV4NQHFNIFF7VWNFQ”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “Action”: “PUT_REPAIR”, “Available Space”: 2226638171092}
2021-11-09T20:26:45.770Z INFO piecestore upload started {“Piece ID”: “KWEPEOTZVQPGCTDJKWC5ETXOUDCLDQNOS2Y2QTDIFVZ5PXZPR45A”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:26:45.770Z INFO piecestore upload started {“Piece ID”: “NTHCPWNZTOUVVVGAKGNJHBKVNBIGJAVJOMD6ED7ZC7ZZ325BOT3Q”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:26:45.771Z INFO piecestore upload started {“Piece ID”: “JECMENJY43MMS5CZ5RDIUZBXSKKIRVYC3DOXPOZFWP4M6JWXKRVA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:26:45.771Z INFO piecestore upload started {“Piece ID”: “RGXTLTRHPM4YQEIDMBO54Y56Q2JF5ZWVMQKNUTLZMXCWEEQYQO4Q”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:26:45.771Z INFO piecestore upload started {“Piece ID”: “7T7UHOJGVSCOCQIQIW6OHFVPNM77QURNASYWDASLFPX46BBTGKTQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:26:45.772Z INFO piecestore upload started {“Piece ID”: “N2JZIIIVTGA553QE3C6Z3GLWE4DL74M324RPIKJL2P2URNHQRTAQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226638171092}
2021-11-09T20:26:45.804Z ERROR piecestore error sending hash and order limit {“error”: “context canceled”}
2021-11-09T20:26:45.804Z INFO piecestore download canceled {“Piece ID”: “LLTSIBX6EBCKTUMALJWHNZXGZMDR7ZK6X3PWE6AHRHY44NET2LOA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET_REPAIR”}
2021-11-09T20:29:43.355Z INFO Configuration loaded {“Location”: “/app/config/config.yaml”}
2021-11-09T20:29:43.381Z INFO Operator email {“Address”: “xxx@xxx”}
2021-11-09T20:29:43.381Z INFO Operator wallet {“Address”: “xxx”}
2021-11-09T20:29:45.480Z INFO Telemetry enabled {“instance ID”: “12a5yXMvcnYtdHqwgCdSju8vcq23Ad2y8XsFy2wwWRemetGp1ve”}
2021-11-09T20:29:45.788Z INFO db.migration Database Version {“version”: 53}
2021-11-09T20:29:46.560Z INFO preflight:localtime start checking local system clock with trusted satellites’ system clock.
2021-11-09T20:29:47.498Z INFO preflight:localtime local system clock is in sync with trusted satellites’ system clock.
2021-11-09T20:29:47.499Z INFO bandwidth Performing bandwidth usage rollups
2021-11-09T20:29:47.500Z INFO Node 12a5yXMvcnYtdHqwgCdSju8vcq23Ad2y8XsFy2wwWRemetGp1ve started
2021-11-09T20:29:47.501Z INFO Public server started on [::]:xxx
2021-11-09T20:29:47.501Z INFO Private server started on 127.0.0.1:xxx
2021-11-09T20:29:47.502Z INFO failed to sufficiently increase receive buffer size (was: 208 kiB, wanted: 2048 kiB, got: 416 kiB). See UDP Receive Buffer Size · quic-go/quic-go Wiki · GitHub for details.
2021-11-09T20:29:47.503Z INFO trust Scheduling next refresh {“after”: “6h24m57.259882408s”}
2021-11-09T20:29:47.989Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “YZ2W5WEJMQ45PJQSOLKRIUH5225HAQSPA3RSGDZGJ2GW5DKSKBCQ”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:92\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-09T20:29:48.057Z INFO piecestore upload started {“Piece ID”: “CZTISUE7ZU2COQVCXGPA7VGRTPQF72M4VTW2TO47TVKCKPQEL52A”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226646003412}
2021-11-09T20:29:48.870Z INFO piecestore download started {“Piece ID”: “3IZVM776LJLJATBTB27M62Z5L32F7GSMXPE6ENF2RKXELSDMIAHQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET”}
2021-11-09T20:29:49.880Z INFO piecestore upload started {“Piece ID”: “MKM6UKJSJCPZOIJEJSMCWJUYLLYYI7BJ53Z6NQMZ5ONDMK6GHUSQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226646003412}
2021-11-09T20:29:50.034Z INFO piecestore upload started {“Piece ID”: “EXGWSMG3YJM4UDGO4TSSACKAPJCKMYZTEOFPOJT33F3TNU5TVP4Q”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226646003412}
2021-11-09T20:29:50.688Z INFO piecestore upload started {“Piece ID”: “TQHCNDKTCDNLCXZR7X6QG53JWMRDZ3BPSOUHTCYCQBM5GZZGLONQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226646003412}
2021-11-09T20:29:52.312Z INFO piecestore upload started {“Piece ID”: “MUDPVBY5M7HVNGDIYWZXV4PEOSJ7MUDOYTOC4MEOI2XT4YGQ62TQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226646003412}
2021-11-09T20:29:52.938Z WARN contact:service Your node is still considered to be online but encountered an error. {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Error”: “contact: failed to dial storage node (ID: 12a5yXMvcnYtdHqwgCdSju8vcq23Ad2y8XsFy2wwWRemetGp1ve) at address t42.dyndns.org:28967 using QUIC: rpc: quic: timeout: no recent network activity”}
2021-11-09T20:29:53.354Z WARN contact:service Your node is still considered to be online but encountered an error. {“Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Error”: “contact: failed to dial storage node (ID: 12a5yXMvcnYtdHqwgCdSju8vcq23Ad2y8XsFy2wwWRemetGp1ve) at address t42.dyndns.org:28967 using QUIC: rpc: quic: timeout: no recent network activity”}
2021-11-09T20:29:53.372Z WARN contact:service Your node is still considered to be online but encountered an error. {“Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Error”: “contact: failed to dial storage node (ID: 12a5yXMvcnYtdHqwgCdSju8vcq23Ad2y8XsFy2wwWRemetGp1ve) at address t42.dyndns.org:28967 using QUIC: rpc: quic: timeout: no recent network activity”}
2021-11-09T20:29:53.621Z WARN contact:service Your node is still considered to be online but encountered an error. {“Satellite ID”: “12tRQrMTWUWwzwGh18i7Fqs67kmdhH9t6aToeiwbo5mfS2rUmo”, “Error”: “contact: failed to dial storage node (ID: 12a5yXMvcnYtdHqwgCdSju8vcq23Ad2y8XsFy2wwWRemetGp1ve) at address t42.dyndns.org:28967 using QUIC: rpc: quic: timeout: no recent network activity”}
2021-11-09T20:29:53.715Z WARN contact:service Your node is still considered to be online but encountered an error. {“Satellite ID”: “1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE”, “Error”: “contact: failed to dial storage node (ID: 12a5yXMvcnYtdHqwgCdSju8vcq23Ad2y8XsFy2wwWRemetGp1ve) at address t42.dyndns.org:28967 using QUIC: rpc: quic: timeout: no recent network activity”}
2021-11-09T20:29:53.902Z INFO piecestore upload started {“Piece ID”: “FCY5FZLNRXV3MCOY36IRG6NSCMVIAC4LM35HHY36ZILZZ7YHVQTA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226645970388}
2021-11-09T20:29:54.018Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “3GG7SHCGLCL2NCIVTXGOIPIUCME6O7TX7HABK4DJLORTJRHAUXTA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:92\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-09T20:29:54.232Z WARN contact:service Your node is still considered to be online but encountered an error. {“Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “Error”: “contact: failed to dial storage node (ID: 12a5yXMvcnYtdHqwgCdSju8vcq23Ad2y8XsFy2wwWRemetGp1ve) at address t42.dyndns.org:28967 using QUIC: rpc: quic: timeout: no recent network activity”}
2021-11-09T20:29:59.222Z INFO piecestore upload started {“Piece ID”: “PDINPTHBGOPUUJEAIQOTSC26XKM4C2ARFPBCHVYQXKB4EF6PD3FQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226645970388}
2021-11-09T20:29:59.223Z INFO piecestore upload started {“Piece ID”: “XV3JN65DPNLYYHX66IVODZXDOPOHC6HE5APV7XQVUDYOFXEVAWSQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226645970388}
2021-11-09T20:29:59.223Z INFO piecestore upload started {“Piece ID”: “TC5XWY4HFPDDO4TWU76SEKK3EJ6U25IEHSDVENADA3W6OGGLGZJQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226645970388}
2021-11-09T20:29:59.229Z INFO piecestore upload started {“Piece ID”: “2PKH65EJT3XGAJOGTBJKBL3RW5SLAJEJSIGZHVBHXYG6Y5ZNLXCQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 2226645970388}
Ok, it looks like the OS may have killed the process:
2021-11-09T20:26:44.777Z INFO Got a signal from the OS: “terminated”
Can you run this command and report the output for the “State” field please?
docker inspect e3336b575f3f
Edit: I think you might be able to do that with this
docker inspect --format='{{json .State}}' e3336b575f3f
This:
$ docker inspect --format=‘{{json .State}}’ e3336b575f3f
{“Status”:“running”,“Running”:true,“Paused”:false,“Restarting”:false,“OOMKilled”:false,“Dead”:false,“Pid”:1763,“ExitCode”:0,“Error”:“”,“StartedAt”:“2021-11-10T09:05:20.726833584Z”,“FinishedAt”:“2021-11-10T09:05:20.217188459Z”}
I just updated the image and this is the result:
$ docker inspect e332f7e26572
[
{
“Id”: “e332f7e265723e4955b82796984d0f3e7afac0613756247fcad7e5f335b46adf”,
“Created”: “2021-11-10T10:23:09.126718002Z”,
“Path”: “/entrypoint”,
“Args”: ,
“State”: {
“Status”: “running”,
“Running”: true,
“Paused”: false,
“Restarting”: false,
“OOMKilled”: false,
“Dead”: false,
“Pid”: 1915,
“ExitCode”: 0,
“Error”: “”,
“StartedAt”: “2021-11-10T10:23:09.313747793Z”,
“FinishedAt”: “0001-01-01T00:00:00Z”
},
“Image”: “sha256:f88f1493493eee630401837631bf333b9565ad23dd7e6065c2dfcf1c0827455f”,
“ResolvConfPath”: “/var/lib/docker/containers/e332f7e265723e4955b82796984d0f3e7afac0613756247fcad7e5f335b46adf/resolv.conf”,
“HostnamePath”: “/var/lib/docker/containers/e332f7e265723e4955b82796984d0f3e7afac0613756247fcad7e5f335b46adf/hostname”,
“HostsPath”: “/var/lib/docker/containers/e332f7e265723e4955b82796984d0f3e7afac0613756247fcad7e5f335b46adf/hosts”,
“LogPath”: “/var/lib/docker/containers/e332f7e265723e4955b82796984d0f3e7afac0613756247fcad7e5f335b46adf/e332f7e265723e4955b82796984d0f3e7afac0613756247fcad7e5f335b46adf-json.log”,
“Name”: “/storagenode”,
“RestartCount”: 0,
“Driver”: “overlay2”,
“Platform”: “linux”,
“MountLabel”: “”,
“ProcessLabel”: “”,
“AppArmorProfile”: “”,
“ExecIDs”: null,
“HostConfig”: {
“Binds”: null,
“ContainerIDFile”: “”,
“LogConfig”: {
“Type”: “json-file”,
“Config”: {}
},
“NetworkMode”: “default”,
“PortBindings”: {
“14002/tcp”: [
{
“HostIp”: “”,
“HostPort”: “14002”
}
],
“28967/tcp”: [
{
“HostIp”: “”,
“HostPort”: “28967”
}
]
},
“RestartPolicy”: {
“Name”: “unless-stopped”,
“MaximumRetryCount”: 0
},
“AutoRemove”: false,
“VolumeDriver”: “”,
“VolumesFrom”: null,
“CapAdd”: null,
“CapDrop”: null,
“CgroupnsMode”: “host”,
“Dns”: ,
“DnsOptions”: ,
“DnsSearch”: ,
“ExtraHosts”: null,
“GroupAdd”: null,
“IpcMode”: “private”,
“Cgroup”: “”,
“Links”: null,
“OomScoreAdj”: 0,
“PidMode”: “”,
“Privileged”: false,
“PublishAllPorts”: false,
“ReadonlyRootfs”: false,
“SecurityOpt”: null,
“UTSMode”: “”,
“UsernsMode”: “”,
“ShmSize”: 67108864,
“Runtime”: “runc”,
“ConsoleSize”: [
0,
0
],
“Isolation”: “”,
“CpuShares”: 0,
“Memory”: 0,
“NanoCpus”: 0,
“CgroupParent”: “”,
“BlkioWeight”: 0,
“BlkioWeightDevice”: ,
“BlkioDeviceReadBps”: null,
“BlkioDeviceWriteBps”: null,
“BlkioDeviceReadIOps”: null,
“BlkioDeviceWriteIOps”: null,
“CpuPeriod”: 0,
“CpuQuota”: 0,
“CpuRealtimePeriod”: 0,
“CpuRealtimeRuntime”: 0,
“CpusetCpus”: “”,
“CpusetMems”: “”,
“Devices”: ,
“DeviceCgroupRules”: null,
“DeviceRequests”: null,
“KernelMemory”: 0,
“KernelMemoryTCP”: 0,
“MemoryReservation”: 0,
“MemorySwap”: 0,
“MemorySwappiness”: null,
“OomKillDisable”: false,
“PidsLimit”: null,
“Ulimits”: null,
“CpuCount”: 0,
“CpuPercent”: 0,
“IOMaximumIOps”: 0,
“IOMaximumBandwidth”: 0,
“Mounts”: [
{
“Type”: “bind”,
“Source”: “/Volumes/storj/Storj/Identity/storagenode”,
“Target”: “/app/identity”
},
{
“Type”: “bind”,
“Source”: “/Volumes/storj”,
“Target”: “/app/config”
}
],
“MaskedPaths”: [
“/proc/asound”,
“/proc/acpi”,
“/proc/kcore”,
“/proc/keys”,
“/proc/latency_stats”,
“/proc/timer_list”,
“/proc/timer_stats”,
“/proc/sched_debug”,
“/proc/scsi”,
“/sys/firmware”
],
“ReadonlyPaths”: [
“/proc/bus”,
“/proc/fs”,
“/proc/irq”,
“/proc/sys”,
“/proc/sysrq-trigger”
]
},
“GraphDriver”: {
“Data”: {
“LowerDir”: “/var/lib/docker/overlay2/2972f32ccb92363266683dff0989aa3575548006acd72c12eeba0d5e625cede5-init/diff:/var/lib/docker/overlay2/365c365bb481ffee03e8319432539946f8303a6b8766b08e5e978e13e532704b/diff:/var/lib/docker/overlay2/ec39226028b0c63e940394ed35183b6b4007d032c46f669a58bb0beb4d1a3aff/diff:/var/lib/docker/overlay2/b0cbfd31cbfd8cc2d1f02941dc4d54e11cac9d8b86a6535d9328432497769269/diff:/var/lib/docker/overlay2/178bffb6a3f606bab1d0deb78b9336668d864d9cf6204351c8dbef36d1040d7c/diff:/var/lib/docker/overlay2/4bdcfc5fe31c683be1b3f71c80ccf982b818556f85c393ce20de9e6761a68c49/diff:/var/lib/docker/overlay2/80cd3de7ffc52b725ced3be5a3c01f467d65cd312d448b2a8bebbe1197131946/diff”,
“MergedDir”: “/var/lib/docker/overlay2/2972f32ccb92363266683dff0989aa3575548006acd72c12eeba0d5e625cede5/merged”,
“UpperDir”: “/var/lib/docker/overlay2/2972f32ccb92363266683dff0989aa3575548006acd72c12eeba0d5e625cede5/diff”,
“WorkDir”: “/var/lib/docker/overlay2/2972f32ccb92363266683dff0989aa3575548006acd72c12eeba0d5e625cede5/work”
},
“Name”: “overlay2”
},
“Mounts”: [
{
“Type”: “bind”,
“Source”: “/Volumes/storj/Storj/Identity/storagenode”,
“Destination”: “/app/identity”,
“Mode”: “”,
“RW”: true,
“Propagation”: “rprivate”
},
{
“Type”: “bind”,
“Source”: “/Volumes/storj”,
“Destination”: “/app/config”,
“Mode”: “”,
“RW”: true,
“Propagation”: “rprivate”
}
],
“Config”: {
“Hostname”: “e332f7e26572”,
“Domainname”: “”,
“User”: “”,
“AttachStdin”: false,
“AttachStdout”: false,
“AttachStderr”: false,
“ExposedPorts”: {
“14002/tcp”: {},
“28967/tcp”: {}
},
“Tty”: false,
“OpenStdin”: false,
“StdinOnce”: false,
“Env”: [
“WALLET=XXX”,
“EMAIL=XXX”,
“ADDRESS=XXX:28967”,
“STORAGE=5TB”,
“PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin”,
“GOARCH=arm64”,
“SETUP=false”
],
“Cmd”: null,
“Image”: “storjlabs/storagenode:latest”,
“Volumes”: null,
“WorkingDir”: “/app”,
“Entrypoint”: [
“/entrypoint”
],
“OnBuild”: null,
“Labels”: {},
“StopTimeout”: 300
},
“NetworkSettings”: {
“Bridge”: “”,
“SandboxID”: “eb0d99ba783b00e414241dab8b98d8110c5f7244f2990d358591430428c18268”,
“HairpinMode”: false,
“LinkLocalIPv6Address”: “”,
“LinkLocalIPv6PrefixLen”: 0,
“Ports”: {
“14002/tcp”: [
{
“HostIp”: “0.0.0.0”,
“HostPort”: “14002”
}
],
“28967/tcp”: [
{
“HostIp”: “0.0.0.0”,
“HostPort”: “28967”
}
]
},
“SandboxKey”: “/var/run/docker/netns/eb0d99ba783b”,
“SecondaryIPAddresses”: null,
“SecondaryIPv6Addresses”: null,
“EndpointID”: “5da678aec2c8c8d07fec7903030d20170acdb3fa963e09cef83492af889c2d12”,
“Gateway”: “172.17.0.1”,
“GlobalIPv6Address”: “”,
“GlobalIPv6PrefixLen”: 0,
“IPAddress”: “172.17.0.2”,
“IPPrefixLen”: 16,
“IPv6Gateway”: “”,
“MacAddress”: “02:42:ac:11:00:02”,
“Networks”: {
“bridge”: {
“IPAMConfig”: null,
“Links”: null,
“Aliases”: null,
“NetworkID”: “b462b4de0343cd29e5761f14f64ef3fcc7829b4b64448427ec0ba92c6c31e2e1”,
“EndpointID”: “5da678aec2c8c8d07fec7903030d20170acdb3fa963e09cef83492af889c2d12”,
“Gateway”: “172.17.0.1”,
“IPAddress”: “172.17.0.2”,
“IPPrefixLen”: 16,
“IPv6Gateway”: “”,
“GlobalIPv6Address”: “”,
“GlobalIPv6PrefixLen”: 0,
“MacAddress”: “02:42:ac:11:00:02”,
“DriverOpts”: null
}
}
}
}
]
While the command docker inspect --format=‘{{json .State}}’, returns me this:
$ docker inspect --format=‘{{json .State}}’ e332f7e26572
{“Status”:“running”,“Running”:true,“Paused”:false,“Restarting”:false,“OOMKilled”:false,“Dead”:false,“Pid”:1915,“ExitCode”:0,“Error”:“”,“StartedAt”:“2021-11-10T10:23:09.313747793Z”,“FinishedAt”:“0001-01-01T00:00:00Z”}
Ah, so since you restarted it and it is now running, this info won’t help us figure out why the node stopped originally. If the node stops, please try to get this info again before restarting.
It may potentially be that the OS terminated the process for using too much memory.
If that were the case, you could try increasing the memory allocation in the docker settings
Now the node shouldn’t be offline, docker is running and the log says this:
docker logs --tail 50 e332f7e26572
2021-11-11T08:18:24.921Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “WVLASHQJ7C2WS677NAEUJ5PS54TWV2AOLX656ZM43BSO53QM4TXA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:24.948Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “OFTNY2LJXQAU54OSQJGC6QNWHDD4VEN73BB6V2MQU7UEYBMYQDBA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:24.968Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “BGBGCDATRB5QEZJCWKSGVQXGH4MATTAMYWUYYXBP3R74AZBA23NQ”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:24.985Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “U7DID4X64LXD4JC5LBPE6P27M6BB53RWNRIWBF73XS2K7VVAXSBA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.008Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “2ITVUF6AD352ZBOKAO3FDDVJ3MR2U23UBC72HO5BHISFWI6G2AQA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.026Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “Z7OO5Q5X4H57YZHIVXLZLO2WJOUQQOR5FPGLFXT6GXPYJFJWGSPQ”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.084Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “LUN523ZUQBCZ2I4PEBWS74EOIKUIUVOR7F7Q5TDGZ6ZIF72LRDSA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.106Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “OWSA3I4MKC7NQ2PU4BJ6NSHSUWT7CU2HCRQZ7AVPGBTP4QPN5IIA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.145Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “7VKGJFXH2IZTDMSHZ2ATYBVMW75CQKXDJXURR7VUTPRIUOJQU62A”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.150Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “M2M5UVISVKNXCUJJYEBXZMXHLHMDTTDHFLHHD4LKR6RFBJP2RV6A”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.189Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “DJXVU7T5FYTJO74C7UUIOVBUTTAQLJCTBRALWOOTOKMNCSVVELTA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.201Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “QO5KPUDPBXL4QJZNJ2L2DSEVTXPUNTITJTGOQM6LOLPF5WA4754A”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.224Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “B3KGWMBEFW23NYE3YGC6EYDFLEDHFYZQOAEZTE7KKKJGJMQWHF2A”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.239Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “3TTDXF5WN2REUTE6UIVYNYB2ZJOY24M4S6J3YILXSKKXFYG4E44Q”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.264Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “6LCTZOISBR7ZVYAYTAGXIYBVFQM754GXYYH66V2RHHMFFFCILEDQ”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.278Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “R3EOR5JJ2LBN4534MP4D6MIXPYBYX3OWFNKJYVMBZPDN2KSJZHIQ”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.318Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “QXJVHQTPFG2EFENE62FRCAKHTYIWDHAXW4DWZ5IYILODABRIU7OQ”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.336Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “WYFI2YUV67ACJXEYTQCF2BXQWJQROFIX2LNMCUKSHC26YRYGA2YQ”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.351Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “5BI4TYFCYT6VPHBLLO3G4DLX4TYXYZ7TAX3NGQJPW4IURTD2FC6A”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.374Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “SFSYLRDIUNY2IBWQMV64RHZG3KW4U6FX5TRWWB4S7RH7LP5YD4BA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.426Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “AM2CMRSIZ2IG5OGQPH6IIZHX4BWE677TVQWG6LT463PUACHHE6XA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.451Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “UA3WBHKLLJF727R7GDB5UHKSBKFBA76JBIYDECD4TLH3AQQENIOA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.470Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “NKEM77SLIZBNENVYSGF4C6BWLIRLQOEEY3ODSCLOVZMO7GV4V7KA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.481Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “3LRATNWQ56UJRHQ7R2N6OYTZAWV5ETVICQUZGHYSAFDY7B2XROUA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.503Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “JYLRAVFHOWZMO2QLUFXSYOPQHVMJFJK56I2SYCROJS7BGKFOM2YQ”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.518Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “NEBLDZ5HQL4N5NAFTSU3FYAWO2MECMGDSB52CKAALKC44KCKA27A”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.543Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “X2NQDOYXGTGW6SVOZEIBQ5N2J3KWOSI6DFK4L5ZK6FJ4UCYIE7WA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.596Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “4EAVCQKQISVKMTUETWOTMIP74WFRAFGCXPIHKE3QTJFXT5TNUJHA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
2021-11-11T08:18:25.634Z ERROR collector unable to delete piece {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “IBGOBODVGBXNM7JBPF6H3YX47ADVV33SG4PLPPCXPS42QBDVAOQA”, “error”: “pieces error: filestore error: file does not exist”, “errorVerbose”: “pieces error: filestore error: file does not exist\n\tstorj.io/storj/storage/filestore.(*blobStore).Stat:103\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).pieceSizes:239\n\tstorj.io/storj/storagenode/pieces.(*BlobsUsageCache).Delete:220\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:299\n\tstorj.io/storj/storagenode/collector.(*Service).Collect:97\n\tstorj.io/storj/storagenode/collector.(*Service).Run.func1:57\n\tstorj.io/common/sync2.(*Cycle).Run:152\n\tstorj.io/storj/storagenode/collector.(*Service).Run:53\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2.1:87\n\truntime/pprof.Do:40\n\tstorj.io/storj/private/lifecycle.(*Group).Run.func2:86\n\tgolang.org/x/sync/errgroup.(*Group).Go.func1:57”}
What I have to do to run normally this node?
I’m going to restart docker to see if it come back to normal operation
Eventually the problem was with docker: since I can’t assign more RAM, I tried assigning two CPU instead of one and now everything seems working good.
Many thanks to all!
1 Like