Satelitte online < 100%

Hello,

I have some trouble, I didn’t understand what’s happen. My node is Online and working (and I just check, it is up2date). I can see some Egress and Ingress. But Online from satelite are under 100% and go down regularly.

Here are my last logs. Do you have any idea?

Olivier

Status ONLINE
Uptime 9m40s

               Available        Used        Egress       Ingress
 Bandwidth           N/A     0.67 TB     123.92 GB     544.57 GB (since Dec 1)
      Disk       1.95 TB     2.05 TB

Internal 127.0.0.1:7778
External 76.71.180.193:28967

olange@storj:~$ sudo docker logs --tail 200 storagenode
2020-12-26T20:44:17.321Z INFO Node 1WG6G8TMTtdmbKTdX18FgEa9XUcyREfHF1r6J39A5DQhUnE4Qy started
2020-12-26T20:44:17.321Z INFO Public server started on [::]:28967
2020-12-26T20:44:17.321Z INFO Private server started on 127.0.0.1:7778
2020-12-26T20:44:17.321Z INFO bandwidth Performing bandwidth usage rollups
2020-12-26T20:44:29.186Z INFO piecestore upload started {“Piece ID”: “MVBA5I6JX2EFOS5XBSBYO6A6EFMVXLBR6TNSWMLEJXFTNQZTHPHA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947161453056}
2020-12-26T20:44:29.279Z INFO piecestore uploaded {“Piece ID”: “MVBA5I6JX2EFOS5XBSBYO6A6EFMVXLBR6TNSWMLEJXFTNQZTHPHA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:44:30.498Z WARN console:service unable to get Satellite URL {“Satellite ID”: “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”, “error”: “storage node dashboard service error: trust: satellite “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW” is untrusted”, “errorVerbose”: “storage node dashboard service error: trust: satellite “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW” is untrusted\n\tstorj.io/storj/storagenode/trust.(*Pool).getInfo:228\n\tstorj.io/storj/storagenode/trust.(*Pool).GetNodeURL:167\n\tstorj.io/storj/storagenode/console.(*Service).GetDashboardData:168\n\tstorj.io/storj/storagenode/console/consoleapi.(*StorageNode).StorageNode:44\n\tnet/http.HandlerFunc.ServeHTTP:2042\n\tgithub.com/gorilla/mux.(*Router).ServeHTTP:210\n\tnet/http.serverHandler.ServeHTTP:2843\n\tnet/http.(*conn).serve:1925”}
2020-12-26T20:44:38.903Z INFO piecestore upload started {“Piece ID”: “77DSDVFK2XBMZTDKA3JJ7CYNCI53O4EZW67QCLD5HBWHX2WMSKEA”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “Action”: “PUT_REPAIR”, “Available Space”: 1947161451008}
2020-12-26T20:44:38.997Z INFO piecestore upload started {“Piece ID”: “WUUV57GMYK4HX3H7UO34EMD5BBOQJZLIHC453VM7XJ6CBDECWXNA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947161451008}
2020-12-26T20:44:39.157Z INFO piecestore uploaded {“Piece ID”: “WUUV57GMYK4HX3H7UO34EMD5BBOQJZLIHC453VM7XJ6CBDECWXNA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
[…]
2020-12-26T20:49:00.684Z INFO piecestore download started {“Piece ID”: “GQQ7KQF4IQF2V3R2ZBMAAZM353GQLFXT4M3DU65GQQNHXFVNIBVQ”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “GET_AUDIT”}
2020-12-26T20:49:00.854Z INFO piecestore downloaded {“Piece ID”: “GQQ7KQF4IQF2V3R2ZBMAAZM353GQLFXT4M3DU65GQQNHXFVNIBVQ”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “GET_AUDIT”}
2020-12-26T20:49:11.244Z INFO piecestore upload started {“Piece ID”: “BCEVC5CKHXTNB25NPIATE3ZBTBTRZCCE52EEP6Z237CLOAA3GYSA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947150236672}
2020-12-26T20:49:11.283Z INFO piecestore uploaded {“Piece ID”: “BCEVC5CKHXTNB25NPIATE3ZBTBTRZCCE52EEP6Z237CLOAA3GYSA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:49:19.040Z INFO piecestore upload started {“Piece ID”: “2SOXFMYVLHQKAZMQ22WRWNVY6UGS76PIWOYSYIC7ANNO7TLRQPBA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947150235392}
2020-12-26T20:49:19.085Z INFO piecestore uploaded {“Piece ID”: “2SOXFMYVLHQKAZMQ22WRWNVY6UGS76PIWOYSYIC7ANNO7TLRQPBA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:49:19.786Z INFO piecestore upload started {“Piece ID”: “PN65H5QCSMFSEK24U5S2476U5ERKSEPTN65SYDVJJYMINWZSNH3A”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”, “Available Space”: 1947150233344}
2020-12-26T20:49:20.248Z INFO piecestore uploaded {“Piece ID”: “PN65H5QCSMFSEK24U5S2476U5ERKSEPTN65SYDVJJYMINWZSNH3A”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”}
2020-12-26T20:49:21.263Z INFO piecedeleter deleted {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “PN65H5QCSMFSEK24U5S2476U5ERKSEPTN65SYDVJJYMINWZSNH3A”}
2020-12-26T20:49:35.878Z INFO piecestore upload started {“Piece ID”: “226ULIF6DX76PTMLCU43U6FUVQCCYN3FHU7XSR4YBBWECX6SFWDA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947150233344}
2020-12-26T20:49:35.901Z INFO piecestore uploaded {“Piece ID”: “226ULIF6DX76PTMLCU43U6FUVQCCYN3FHU7XSR4YBBWECX6SFWDA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:49:46.267Z INFO piecestore upload started {“Piece ID”: “2JRPOOPLVNGFUCXRVN74INKH2MGJJXJSIYJCGEFKZOCSX4AXZMGA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947150232320}
2020-12-26T20:49:46.456Z INFO piecestore uploaded {“Piece ID”: “2JRPOOPLVNGFUCXRVN74INKH2MGJJXJSIYJCGEFKZOCSX4AXZMGA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:49:52.578Z INFO piecestore upload started {“Piece ID”: “6OIGJERBJABB3D6O2FKRVJ4SHGFT7HCM47PFNW3PWD7NGPFD34LQ”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “PUT”, “Available Space”: 1947150231296}
2020-12-26T20:49:55.872Z INFO piecestore upload started {“Piece ID”: “MPBAM3FD3PNDEEFPLM6Z3ZIB6F62P2DEAHW5E77X2JUXJCYDVSUQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947150231296}
2020-12-26T20:49:55.912Z INFO piecestore uploaded {“Piece ID”: “MPBAM3FD3PNDEEFPLM6Z3ZIB6F62P2DEAHW5E77X2JUXJCYDVSUQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:49:56.695Z INFO piecestore uploaded {“Piece ID”: “6OIGJERBJABB3D6O2FKRVJ4SHGFT7HCM47PFNW3PWD7NGPFD34LQ”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “PUT”}
2020-12-26T20:50:01.346Z INFO piecestore upload started {“Piece ID”: “S3VAYKJQDIA7HFJZE6L67H6JXO766VPXB5AJB5NYRIDDILTID2KA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947147909376}
2020-12-26T20:50:01.380Z INFO piecestore uploaded {“Piece ID”: “S3VAYKJQDIA7HFJZE6L67H6JXO766VPXB5AJB5NYRIDDILTID2KA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:50:01.782Z INFO piecestore download started {“Piece ID”: “6OIGJERBJABB3D6O2FKRVJ4SHGFT7HCM47PFNW3PWD7NGPFD34LQ”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “GET”}
2020-12-26T20:50:04.023Z INFO piecestore upload started {“Piece ID”: “IZLGBQXYYPTYU6UGKN3M4DHEESIIQL4D6RQAZ7276SKKVECYPSBQ”, “Satellite ID”: “1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE”, “Action”: “PUT_REPAIR”, “Available Space”: 1947147907840}
2020-12-26T20:50:05.113Z INFO piecestore uploaded {“Piece ID”: “IZLGBQXYYPTYU6UGKN3M4DHEESIIQL4D6RQAZ7276SKKVECYPSBQ”, “Satellite ID”: “1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE”, “Action”: “PUT_REPAIR”}
2020-12-26T20:50:06.147Z INFO piecestore upload started {“Piece ID”: “SPO2C2ZD3FMTC36LQ4OSS6O6JRQVE3ZHUWKJG27K25OICJ244WOQ”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “PUT_REPAIR”, “Available Space”: 1947145590272}
2020-12-26T20:50:07.303Z INFO piecestore uploaded {“Piece ID”: “SPO2C2ZD3FMTC36LQ4OSS6O6JRQVE3ZHUWKJG27K25OICJ244WOQ”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “PUT_REPAIR”}
2020-12-26T20:50:07.774Z INFO piecestore upload started {“Piece ID”: “6WBK3N5X7TOFACRKFHWL4B4OOXBHVP6U62J2ULE6AANZNJYCS36Q”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947143270400}
2020-12-26T20:50:07.786Z INFO piecestore uploaded {“Piece ID”: “6WBK3N5X7TOFACRKFHWL4B4OOXBHVP6U62J2ULE6AANZNJYCS36Q”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:50:07.890Z INFO piecestore downloaded {“Piece ID”: “6OIGJERBJABB3D6O2FKRVJ4SHGFT7HCM47PFNW3PWD7NGPFD34LQ”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “GET”}
2020-12-26T20:50:10.333Z INFO piecestore upload started {“Piece ID”: “77AFYUV3WWIAFLRVKGYLYOIQKECOISHQSN54FAZGWZRUICZMSTYA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947143268352}
2020-12-26T20:50:10.438Z INFO piecestore uploaded {“Piece ID”: “77AFYUV3WWIAFLRVKGYLYOIQKECOISHQSN54FAZGWZRUICZMSTYA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:50:11.804Z INFO piecedeleter deleted {“Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Piece ID”: “6OIGJERBJABB3D6O2FKRVJ4SHGFT7HCM47PFNW3PWD7NGPFD34LQ”}
2020-12-26T20:50:29.740Z INFO piecestore upload started {“Piece ID”: “WB5DDOW5DR5GLUAQW2CHTYW4BQBRHHL7KWOBZQBZBABSDOLDRKXA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947145586176}
2020-12-26T20:50:29.761Z INFO piecestore uploaded {“Piece ID”: “WB5DDOW5DR5GLUAQW2CHTYW4BQBRHHL7KWOBZQBZBABSDOLDRKXA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:50:33.774Z INFO piecestore upload started {“Piece ID”: “6YQRX62SLCU4S37JKOFCMF2WTV7JXPCMO6H47YL5JJWU4BFFGILQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947145584640}
2020-12-26T20:50:33.840Z INFO piecestore uploaded {“Piece ID”: “6YQRX62SLCU4S37JKOFCMF2WTV7JXPCMO6H47YL5JJWU4BFFGILQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:50:47.760Z INFO piecestore upload started {“Piece ID”: “YBCATUUN2SL3DW4SQK2UYEQ4F2IIEZKRNE6NFQKVJUTHZNVIPZBQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947145583104}
2020-12-26T20:50:47.787Z INFO piecestore uploaded {“Piece ID”: “YBCATUUN2SL3DW4SQK2UYEQ4F2IIEZKRNE6NFQKVJUTHZNVIPZBQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:50:47.886Z INFO piecestore upload started {“Piece ID”: “HGJTH7D7M2O5ADS6BFUTKHAEYMP2BITEGKGLYFAHN7GUFXIG4MGQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947145582080}
2020-12-26T20:50:47.902Z INFO piecestore uploaded {“Piece ID”: “HGJTH7D7M2O5ADS6BFUTKHAEYMP2BITEGKGLYFAHN7GUFXIG4MGQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:50:48.398Z INFO piecestore upload started {“Piece ID”: “VULNLOQFY47MF24CU4L3JVQCPTKOWR3YBICS3JU3Z7ZQUDCB7MTA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947145581056}
2020-12-26T20:50:48.426Z INFO piecestore uploaded {“Piece ID”: “VULNLOQFY47MF24CU4L3JVQCPTKOWR3YBICS3JU3Z7ZQUDCB7MTA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:50:49.102Z INFO piecestore upload started {“Piece ID”: “XCGI3S67SM5NQ5SJHI6M6IYYYVZCOLFI5ULUFVK4OLV26JVMY2EA”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “PUT_REPAIR”, “Available Space”: 1947145579008}
2020-12-26T20:50:49.589Z INFO piecestore uploaded {“Piece ID”: “XCGI3S67SM5NQ5SJHI6M6IYYYVZCOLFI5ULUFVK4OLV26JVMY2EA”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “PUT_REPAIR”}
2020-12-26T20:50:56.940Z INFO piecestore upload started {“Piece ID”: “54LTNOLNPUAA6CN3O4GSVYM3LERVTZKRLL5N35SDE6FPFLWOE66A”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947143259136}
2020-12-26T20:50:56.973Z INFO piecestore uploaded {“Piece ID”: “54LTNOLNPUAA6CN3O4GSVYM3LERVTZKRLL5N35SDE6FPFLWOE66A”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:50:59.276Z WARN console:service unable to get Satellite URL {“Satellite ID”: “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”, “error”: “storage node dashboard service error: trust: satellite “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW” is untrusted”, “errorVerbose”: “storage node dashboard service error: trust: satellite “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW” is untrusted\n\tstorj.io/storj/storagenode/trust.(*Pool).getInfo:228\n\tstorj.io/storj/storagenode/trust.(*Pool).GetNodeURL:167\n\tstorj.io/storj/storagenode/console.(*Service).GetDashboardData:168\n\tstorj.io/storj/storagenode/console/consoleapi.(*StorageNode).StorageNode:44\n\tnet/http.HandlerFunc.ServeHTTP:2042\n\tgithub.com/gorilla/mux.(*Router).ServeHTTP:210\n\tnet/http.serverHandler.ServeHTTP:2843\n\tnet/http.(*conn).serve:1925”}
2020-12-26T20:51:10.161Z INFO piecestore upload started {“Piece ID”: “J66GJ32D5BX3C2MHY2OZKPBV2BD2C27MLF32S5S7RARI7SDR3OUQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT_REPAIR”, “Available Space”: 1947143257344}
[…]
2020-12-26T20:52:01.304Z INFO piecedeleter deleted {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “SGMRTDZZZEQNBSPGNJDDSB67TJFPTXQJGNLSRIY2WMRFU5CP54PA”}
2020-12-26T20:52:15.830Z INFO piecestore upload started {“Piece ID”: “6BLOABIEKSMWU72SXQPHHHQNDYYSF5INNTFB3UU57TIIWOGYYOCQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”, “Available Space”: 1947143178496}
2020-12-26T20:52:16.150Z INFO piecestore uploaded {“Piece ID”: “6BLOABIEKSMWU72SXQPHHHQNDYYSF5INNTFB3UU57TIIWOGYYOCQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT”}
2020-12-26T20:52:16.904Z INFO piecedeleter deleted {“Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Piece ID”: “6BLOABIEKSMWU72SXQPHHHQNDYYSF5INNTFB3UU57TIIWOGYYOCQ”}
2020-12-26T20:52:34.244Z INFO piecestore upload started {“Piece ID”: “ATSXH765MOOBUTGKEWMWRFSOCXKFBGEKRQLQS6M7XFKVUUGDOAYA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947143178496}
2020-12-26T20:52:34.273Z INFO piecestore uploaded {“Piece ID”: “ATSXH765MOOBUTGKEWMWRFSOCXKFBGEKRQLQS6M7XFKVUUGDOAYA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:52:52.871Z INFO piecestore upload started {“Piece ID”: “NZLL2VOP6BTLETQIIEMVLCZYJDCJAY4F27VZUJKXZM5CTIXUCR2A”, “Satellite ID”: “1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE”, “Action”: “PUT_REPAIR”, “Available Space”: 1947136290816}
2020-12-26T20:52:54.118Z INFO piecestore uploaded {“Piece ID”: “NZLL2VOP6BTLETQIIEMVLCZYJDCJAY4F27VZUJKXZM5CTIXUCR2A”, “Satellite ID”: “1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE”, “Action”: “PUT_REPAIR”}
2020-12-26T20:53:04.236Z INFO piecestore upload started {“Piece ID”: “LSXAWFURTIOPEV4ART34LRCPILRAAPLQV7FNAP6CIXJMT6BJCTLA”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “PUT_REPAIR”, “Available Space”: 1947133970944}
2020-12-26T20:53:11.080Z INFO piecestore uploaded {“Piece ID”: “LSXAWFURTIOPEV4ART34LRCPILRAAPLQV7FNAP6CIXJMT6BJCTLA”, “Satellite ID”: “12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB”, “Action”: “PUT_REPAIR”}
[…]
2020-12-26T20:53:29.219Z INFO piecestore upload started {“Piece ID”: “AC7OLMZU6CR5PYJZ25I6M5WV3NB4ONDIRTQR6B4MYGDNUKDPGT7A”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947131634944}
2020-12-26T20:53:29.450Z INFO piecestore uploaded {“Piece ID”: “AC7OLMZU6CR5PYJZ25I6M5WV3NB4ONDIRTQR6B4MYGDNUKDPGT7A”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:53:29.903Z INFO piecestore upload started {“Piece ID”: “S2TFXC6LU77BCLUXVJSSUXKEYNEQ64BTBLHU75NMZXGHOORQ2TLA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT_REPAIR”, “Available Space”: 1947131622400}
2020-12-26T20:53:30.975Z INFO piecestore uploaded {“Piece ID”: “S2TFXC6LU77BCLUXVJSSUXKEYNEQ64BTBLHU75NMZXGHOORQ2TLA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “PUT_REPAIR”}
2020-12-26T20:53:31.891Z INFO piecestore upload started {“Piece ID”: “OHWOHBFZQVQZ6G3RU7N64FU62AHBOZEDVWQI5QWVYQJG5JX5NJUA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947129302528}
2020-12-26T20:53:31.901Z INFO piecestore uploaded {“Piece ID”: “OHWOHBFZQVQZ6G3RU7N64FU62AHBOZEDVWQI5QWVYQJG5JX5NJUA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:53:33.222Z INFO piecestore upload started {“Piece ID”: “V2KYYZNRYQH2CARM335E6Z4RDY3U2PJQP2XQGCOKYCSCCR7BEGCA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947129300480}
2020-12-26T20:53:33.233Z INFO piecestore uploaded {“Piece ID”: “V2KYYZNRYQH2CARM335E6Z4RDY3U2PJQP2XQGCOKYCSCCR7BEGCA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:53:56.101Z INFO piecestore upload started {“Piece ID”: “NXAHM6DF5FWIMB7SQMN5JN227KDPPTMLTUKHUG6AVA7EXYT6VCQQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947129298432}
2020-12-26T20:53:56.213Z INFO piecestore uploaded {“Piece ID”: “NXAHM6DF5FWIMB7SQMN5JN227KDPPTMLTUKHUG6AVA7EXYT6VCQQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}
2020-12-26T20:53:59.948Z INFO piecestore upload started {“Piece ID”: “TUXMVJYKBT7LRZRPNG2BZTNJW5CRW2QSXWYJ4DKQR2QQTMRTUYCA”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “Action”: “PUT”, “Available Space”: 1947129296384}
2020-12-26T20:53:59.969Z INFO piecestore uploaded {“Piece ID”: “TUXMVJYKBT7LRZRPNG2BZTNJW5CRW2QSXWYJ4DKQR2QQTMRTUYCA”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “Action”: “PUT”}
2020-12-26T20:54:07.006Z INFO piecestore upload started {“Piece ID”: “TB432LWBMEA4O6EQHP4JOHQ433R5JOAHI5VBIYRIOX2JYV7VOSOQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 1947129295360}
2020-12-26T20:54:07.015Z INFO piecestore uploaded {“Piece ID”: “TB432LWBMEA4O6EQHP4JOHQ433R5JOAHI5VBIYRIOX2JYV7VOSOQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”}

That doesn’t look right…

Satellite “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW” was the old test sat’ from Stefan Benten. I’m pretty sure all errors related to this (now retired) satellite can safely be ignored.

Besides, @Onet: What numbers are we talking about? My nodes regularly go down to 99.60 or something because of some small network interruption or IP updates no propagated fast enough by my Dynamic DNS service but as long as these number don’t go to low, Nodes should be fine. A hit to this score recovers automatically 30 days later.

4 Likes

At this time, the percent is downside 90%:
saltlake.tardigrade.io:7777 -> 89.63%
asia-east-1.tardigrade.io:7777 -> 98.34%
us-central-1.tardigrade.io:7777 -> 91.44%
europe-west-1.tardigrade.io:7777 -> 98.23%
europe-north-1.tardigrade.io:7777 -> 93.8%

DNS seems to be good:
ping saltlake.tardigrade.io
PING saltlake.tardigrade.io (35.236.51.151) 56(84) bytes of data.
64 bytes from 151.51.236.35.bc.googleusercontent.com (35.236.51.151): icmp_seq=1 ttl=106 time=88.1 ms
64 bytes from 151.51.236.35.bc.googleusercontent.com (35.236.51.151): icmp_seq=2 ttl=106 time=87.9 ms

or the warning “118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW” I have read the same informations (old sat). But I can’t see any other error. So, I don’t understand what’s happel.

Node seems to be good:
STATUS: Online
UPTIME: 5h 45m
LAST CONTACT: 0m ago
VERSION: v1.18.1
PERIOD: December

And I can see some Egress and Ingress date…

No specific Logs:
olange@storj:~ sudo docker logs storagenode 2>&1 | grep GET_AUDIT | grep failed olange@storj:~
olange@storj:~$ sudo docker logs storagenode 2>&1 | grep GET_AUDIT | grep failed | wc -l
0

And no problem with my port:
Port [28967] is open on 76.71.ZZZ.XXX.

Any Idea? I don’t want to be suspend, for an obscur reason…

Olivier

Was your node down for any reason ?

No. The percente decrease, and my nod still up. For example, 5 hours before, I was 90.37 on saltlake and now 89.63. And uptime is 6h23 and status Online.

I really don’t understand… And I don’t know where found logs on this problem…

Olivier

If your uptime is only 6 hours you obviously had some down time. I would recommend using uptimerobot.com to keep track of your nodes uptime so you know how much downtime you actually have.

1 Like

My last uptime was an upgrade to be sure to have the last version of storenode. I never has this kind of problem since july. juste the last 24h my online status decrease, but my supsension is 100%, my Audit is 100%, and my VM is fully ready.

What is the online value ? How can I check if there are some problem somewhere. That is my question. (and I confirme that I have no other downtime)

Online % doesn’t mean there is a problem just means your node was offline during a check. So when your node comes back online it gets checked.

When was this cause you posted a version 1.18.1.

i’ve seen up to 40 hours delay in uptime score being adjusted…
it’s highly accurate the more data you got, but also slow to be applied to the dashboard.

and in case of my node at 14tb downtime of like 30sec will be registered in my uptime score, and it still took 40 hours to completely apply to the same node… maybe from different satellites or whatever i duno… just know how long it took since i tracked the last point i was offline and to the time when the last online score was changed.

because i was purposely causing the downtime… (kinda had to… but still purposely, so figured i would make the most of it an learn about the online score’s behavior)

in short simple terms, the online score is your storagenode’s estimated online time over the last month for a particular satellite, and the more data you have for the satellite the more accurate the online score will be.

You can read more there: https://documentation.storj.io/resources/faq/how-the-online-score-is-calculated
@SGC please, try to remember - 12 hours, not 40.

i’ve literally timed it to that… so yeah maybe it’s wrong… but it’s the number i got when testing it.
had a period of a few days where i was doing some troubleshooting, and testing online score.

from when i stopped, it took about 40 hr until the last drop was on the dashboard… granted it wasn’t monitored very accurately, could easily be off by 5-10 hours… and it being only one test, again it could be some random thing i didn’t take into account…

but that’s the number i got, have not read about it anywhere… but if you say it’s suppose to be 12 hours, then sure… it may be right…
this is after all your job so, i would say there is a strong chance of your correctness.

i’ll tell you what… i can try to remember to say there is a significant delay on the online score updating / stop dropping after downtime.

best i can do :smiley: and really doesn’t really matter that much imo… just important that people are aware that it takes a long time for the online score to stop dropping… else they get confused.

Please, do not take on your account, but we already talked about this there:


And you used again the wrong number in the next post after the right answer

There are was also such threads where you was pointed to the same number, but you still uses the same wrong number.
So, this is why I asked you to try to remember. Please, forgive me if I offended you.

1 Like

nah not really… just kinda makes me want to rerun the test on it… see if i get a number closer to 12 hours this time…

and even with the data provided there i could poke some holes in it… just because a window is 12 hours doesn’t mean the dashboard is instantly updated… or atleast i would assume so… there would have to be some sort of accounting going on for that window, so the delay would theoretically always have to be more than the length of the window…

just saying, but yeah it’s a pretty number.

You are right. The information from the satellites on the dashboard updated once at 12 hours too. The dashboard updates when you click Refresh or Reload, it doesn’t have an autoupdate feature.
I don’t think that those windows are synchronous, so at max it shouldn’t be more than 24 hours for the one satellite.
Each satellite updates its information independently.
But if you restart the storagenode, it should take this information immediately (the previous state, the current restart could be noticed by the satellite and reported in the next check-in).

i really have no clue aside from that i measured it to below 40 but above maybe 20 maybe 24…can’t really remember i’m sure i would have mentioned it in the previous discussion about it.

wasn’t really paying much attention to the online score, it was just a little interesting test to run to get some answer on something that many has been very confused about…

and noticed there was a delay and i wanted an idea about how long it was, because it threw me off because it seemed to drop and then drop more later.

it’s one measurement… on something that’s maybe very variable… thus a very gross estimation.
if i tell people how long it takes i over estimate, so they won’t start to wonder again when the initial time is up if i give them an underestimated number…

because then they are back in the state of confusion where we were trying to pull them up from.

and since it’s not any critical thing a bit of downtime, at worst they get a suspension, thus nothing to be alarmed about… so i overestimate.

sometimes there is meaning to my madness :smiley:

Its defiantly not 40 hours though, I recently had downtime for about 59mins max And I happened to fall into the time it updates because I went from 100% to 98% on one of my nodes.


image

This is another node running on the same rpi4
Much newer

Max downtime was 59mins it wasnt down for many hours.

i restarted many times over a period of a few days… and my network crashed, sometimes for 5 or so hours other times it was down for near 24 hours, after that sequence, i noticed that the time didn’t correlate, so i measured from i stopped having downtime, until my online score stopped dropping.

it seems very erratic… sometimes it would update in not much time…

i was pretty impressed that it registered less than 1 minute of downtime on my big storagenode.

some of the satellites on the smaller nodes barely even register i had downtime :smiley:
but unvetted nodes are just that slow i guess… but kinda funny since i ended up with nearly 9% loss total… but some of them are like 97% still

I noticed my downtime 3 hours after starting the nodes back up.

i duno if the continual downtimes in sequences over days could affect something that has a longer cycle…

the first downtime was so minute… and like you say… it got registered fairly quickly

but hey… we know it works like it’s suppose to, seems very accurate, and pretty reliable…
i did some rough math of my total downtime compared to what the most active satellites on my big node got in online score… and it was like very close…

started out with ,… I SO DIDN’T HAVE NEAR 10% DT
goes into proxmox graphs and starts adding up and ends at about the same number…
so all in all i’m pretty impressed with just how well it works.