I don’t see any strange errors in the records. At this hour the ratio remains the same.
What are the criteria for disqualifying the satellite?
The online score is calculated within 30 days window, to fully recover your node should be online for the next 30 days. See How is the online score calculated? - Storj Docs
You may check when your node was unavailable with these scripts:
You may also search for "ping satellite failed" except "rate" in your logs to see a real reason, why your node was unavailable.
When it would be greater than 60%, your node should be unsuspended on the ap1 satellite.
How can I verify this data from docker?
docker exec -it storagenode wget -q -O - http://localhost:14002/api/sno/satellites
You will get a json response, so if you have jq installed, you may prettify it
docker exec -it storagenode wget -q -O - http://localhost:14002/api/sno/satellites | jq '.audits'
Or use
However, it’s simpler to use a web-dashboard. If you want to see it from the other device, you may use How to remote access the web dashboard - Storj Docs or [Tech Preview] Multinode Dashboard Binaries
Hello, I explained myself wrong, what I wanted to say is how can I know if there is communication with the satellite from docker.
Because according to my firewall there is communication.
According to the monitoring of port 28967 that I do from an external service, there is no loss of connectivity and the port is open.
That’s why I don’t understand how it is possible that the ratio remains at 53.72% for several days.
When I apply
docker logs storagenode 2>&1 | grep -E “GET_AUDIT|GET_REPAIR” | grep failed
SHow me:
2023-12-12T15:49:20Z ERROR piecestore download failed {“process”: “storagenode”, “Piece ID”: “PDGATY5V2BKP46ZM2SG3BFC2CHMBUBUPQGR2EYC673YZVA2LWFXQ”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “Action”: “GET_REPAIR”, “Offset”: 0, “Size”: 1048064, “Remote Address”: “128.140.100.191:48350”, “error”: “manager closed: read tcp 10.0.3.2:28967->128.140.100.191:48350: read: connection timed out”, “errorVerbose”: “manager closed: read tcp 10.0.3.2:28967->128.140.100.191:48350: read: connection timed out\n\tstorj.io/drpc/drpcmanager.(*Manager).manageReader:231”}
2023-12-12T16:05:01Z ERROR piecestore download failed {“process”: “storagenode”, “Piece ID”: “ZYFZLQWYRHD5N6ERKL3VOCGQ5RST4SQ3IL4RFSXGYK37SDHXQGYQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET_REPAIR”, “Offset”: 0, “Size”: 1218560, “Remote Address”: “128.140.39.117:52596”, “error”: “manager closed: read tcp 10.0.3.2:28967->128.140.39.117:52596: read: connection timed out”, “errorVerbose”: “manager closed: read tcp 10.0.3.2:28967->128.140.39.117:52596: read: connection timed out\n\tstorj.io/drpc/drpcmanager.(*Manager).manageReader:231”}
2023-12-12T16:06:36Z ERROR piecestore download failed {“process”: “storagenode”, “Piece ID”: “YNYP5BQ56KTXQQI6IMVALBVP7LJVZ75ZFIOMUIPVBITERGMYRLTQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET_REPAIR”, “Offset”: 0, “Size”: 1218560, “Remote Address”: “199.102.71.14:50428”, “error”: “manager closed: read tcp 10.0.3.2:28967->199.102.71.14:50428: read: connection timed out”, “errorVerbose”: “manager closed: read tcp 10.0.3.2:28967->199.102.71.14:50428: read: connection timed out\n\tstorj.io/drpc/drpcmanager.(*Manager).manageReader:231”}
2023-12-12T16:47:58Z ERROR piecestore download failed {“process”: “storagenode”, “Piece ID”: “4TE7CS4K447C7LJEWLPWFBOHJFTNL7ZD3ZTKSIEX3TKJT54FMR6A”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET_REPAIR”, “Offset”: 0, “Size”: 1218560, “Remote Address”: “199.102.71.13:36516”, “error”: “manager closed: read tcp 10.0.3.2:28967->199.102.71.13:36516: read: connection timed out”, “errorVerbose”: “manager closed: read tcp 10.0.3.2:28967->199.102.71.13:36516: read: connection timed out\n\tstorj.io/drpc/drpcmanager.(*Manager).manageReader:231”}
2023-12-12T16:53:48Z ERROR piecestore download failed {“process”: “storagenode”, “Piece ID”: “D7IH4D2C62I2USPOQUY47OZMK5RIV3HAHQKMCNQQB4MHI4UCZXMQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET_REPAIR”, “Offset”: 0, “Size”: 1218560, “Remote Address”: “199.102.71.26:56396”, “error”: “manager closed: read tcp 10.0.3.2:28967->199.102.71.26:56396: read: connection timed out”, “errorVerbose”: “manager closed: read tcp 10.0.3.2:28967->199.102.71.26:56396: read: connection timed out\n\tstorj.io/drpc/drpcmanager.(*Manager).manageReader:231”}
2023-12-12T17:48:48Z ERROR piecestore download failed {“process”: “storagenode”, “Piece ID”: “TNXR5MHOCJ4N6NHJ7DMGFCSHJC6SI5PB53MAYSA2DKU76Z5S5PHQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET_REPAIR”, “Offset”: 0, “Size”: 1218560, “Remote Address”: “128.140.70.163:56836”, “error”: “manager closed: read tcp 10.0.3.2:28967->128.140.70.163:56836: read: connection timed out”, “errorVerbose”: “manager closed: read tcp 10.0.3.2:28967->128.140.70.163:56836: read: connection timed out\n\tstorj.io/drpc/drpcmanager.(*Manager).manageReader:231”}
2023-12-12T18:12:53Z ERROR piecestore download failed {“process”: “storagenode”, “Piece ID”: “WH5G7W55TARCZQ6EGZ7MYJOSDV4ECO2B3EDAHWHHZEU4FBQLBHJA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET_REPAIR”, “Offset”: 0, “Size”: 1218560, “Remote Address”: “199.102.71.25:42544”, “error”: “manager closed: read tcp 10.0.3.2:28967->199.102.71.25:42544: read: connection timed out”, “errorVerbose”: “manager closed: read tcp 10.0.3.2:28967->199.102.71.25:42544: read: connection timed out\n\tstorj.io/drpc/drpcmanager.(*Manager).manageReader:231”}
2023-12-12T18:13:43Z ERROR piecestore download failed {“process”: “storagenode”, “Piece ID”: “KXWTDXVX2NUXB7UKWFGAMGQZQUFOLSRCZ2HOUVOETO54PXGV6WWA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET_REPAIR”, “Offset”: 0, “Size”: 1218560, “Remote Address”: “116.203.225.81:46118”, “error”: “manager closed: read tcp 10.0.3.2:28967->116.203.225.81:46118: read: connection timed out”, “errorVerbose”: “manager closed: read tcp 10.0.3.2:28967->116.203.225.81:46118: read: connection timed out\n\tstorj.io/drpc/drpcmanager.(*Manager).manageReader:231”}
2023-12-12T18:48:58Z ERROR piecestore download failed {“process”: “storagenode”, “Piece ID”: “63CQOPKCHFJZ37YNGE3VYKXD6PGA5LU6P6RWSN5BCIX3ZFWFLFJA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET_REPAIR”, “Offset”: 0, “Size”: 1218560, “Remote Address”: “128.140.70.163:56124”, “error”: “manager closed: read tcp 10.0.3.2:28967->128.140.70.163:56124: read: connection timed out”, “errorVerbose”: “manager closed: read tcp 10.0.3.2:28967->128.140.70.163:56124: read: connection timed out\n\tstorj.io/drpc/drpcmanager.(*Manager).manageReader:231”}
2023-12-12T19:01:28Z ERROR piecestore download failed {“process”: “storagenode”, “Piece ID”: “JB2HYMOG3SANKQZDPKLFUTZN3ZIG4VTQLG3X4OVEPT7JUC5XPXMA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET_REPAIR”, “Offset”: 0, “Size”: 580096, “Remote Address”: “195.201.216.62:50086”, “error”: “manager closed: read tcp 10.0.3.2:28967->195.201.216.62:50086: read: connection timed out”, “errorVerbose”: “manager closed: read tcp 10.0.3.2:28967->195.201.216.62:50086: read: connection timed out\n\tstorj.io/drpc/drpcmanager.(*Manager).manageReader:231”}
2023-12-12T19:11:57Z ERROR piecestore download failed {“process”: “storagenode”, “Piece ID”: “OSI6WGM2HRNZANWAN2RKYVTP6RTHWIVJQFL6XEBS5MKVOQFJ6RGA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET_REPAIR”, “Offset”: 0, “Size”: 580096, “Remote Address”: “116.203.196.91:46790”, “error”: “manager closed: read tcp 10.0.3.2:28967->116.203.196.91:46790: read: connection timed out”, “errorVerbose”: “manager closed: read tcp 10.0.3.2:28967->116.203.196.91:46790: read: connection timed out\n\tstorj.io/drpc/drpcmanager.(*Manager).manageReader:231”}
2023-12-12T19:16:51Z ERROR piecestore download failed {“process”: “storagenode”, “Piece ID”: “ZZIH3NJ6OA4XJCJAJRXP3GKPXZ5YGDOCNNIU2EV47WC3DDIW6SBA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET_REPAIR”, “Offset”: 0, “Size”: 1218560, “Remote Address”: “128.140.39.117:43730”, “error”: “manager closed: read tcp 10.0.3.2:28967->128.140.39.117:43730: read: connection timed out”, “errorVerbose”: “manager closed: read tcp 10.0.3.2:28967->128.140.39.117:43730: read: connection timed out\n\tstorj.io/drpc/drpcmanager.(*Manager).manageReader:231”}
2023-12-12T20:24:46Z ERROR piecestore download failed {“process”: “storagenode”, “Piece ID”: “K2CRN5SSY7YTHO37AS644VNMA7YO53TZ5MQ2QCC4HN4764ZUPZ7Q”, “Satellite ID”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”, “Action”: “GET_REPAIR”, “Offset”: 0, “Size”: 1218560, “Remote Address”: “116.203.40.151:43208”, “error”: “manager closed: read tcp 10.0.3.2:28967->116.203.40.151:43208: read: connection timed out”, “errorVerbose”: “manager closed: read tcp 10.0.3.2:28967->116.203.40.151:43208: read: connection timed out\n\tstorj.io/drpc/drpcmanager.(*Manager).manageReader:231”}
If you fixed a connectivity issue, the online score will fully recover after 30 days online. Each downtime requires another 30 days to recover.
You may use scripts above to see when your node was not available for the satellites. Unfortunately they will not show the reason, only time intervals of unavailability.
You need to check your firewall’s logs to see why the connections were blocked or dropped, logs of the node will show that something is blocking connections, like:
This means that something is blocking connections between your node and the repair worker and they are closed by a timeout.
This means by logic, if you were 50%offline in a row, after 2 weeks online will increase at 45/15 ~3% per day ? if its staying online.
The small increase could be someting else 30days in the past.
Not like this. Since it’s a sliding time window, it may grow not linear.
See
In this case the single offline 12h timeframes move half a day by half a day out of the 30day window. (with the delay from the satelite?)
ofc i did only a rough estimate for the special case, not an exact calculation.
Maybe? But it depends on time, when your node was rendered as offline.
Hello
I have made some changes to the configuration to improve and it turns out that they have gotten worse in all satellites. I don’t understand it, I’ll tell you what I’ve done.
On 12/13/2023, I changed the Internet connection to another without Firewall.
Change the configuration in docker to the new Public IP.
The website gives me status Online and QUIC Ok
I have opened TCP and UDP port 28967 on the router and the test
gives me open port
During this time the router has not rebooted or lost connection
However, today, after 4 days, in the web, setions Suspension&Audit → Online, I get worse indicators than 4 days ago.
With this command, I don’t get any errors.
docker logs storagenode 2>&1 | grep -E “GET_AUDIT|GET_REPAIR” | grep failed
With this comand show me, I don’t see any errors
2023-12-17T17:23:04Z INFO piecestore downloaded {“process”: “storagenode”, “Piece ID”: “CAMOG3S6TCM5PPE4EDLONHVQ6WFJHJTVJZOFCHSZYMLSW27PLGWA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET”, “Offset”: 1233920, “Size”: 4864, “Remote Address”: “158.180.29.230:33524”}
2023-12-17T17:23:04Z INFO piecestore download started {“process”: “storagenode”, “Piece ID”: “2KJKZFQS6TLVO246D3O4UUODV2R73WQYE3LJKF3ONRTNQTFZ44XQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 0, “Size”: 56832, “Remote Address”: “79.127.226.97:57936”}
2023-12-17T17:23:04Z INFO piecestore download started {“process”: “storagenode”, “Piece ID”: “IJOXZUM2LYWITZ6SZAH2WD3SQRIKTHTQ5DCEMPOLMB6KO5UZDQDQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET”, “Offset”: 1701120, “Size”: 4864, “Remote Address”: “79.127.226.98:58534”}
2023-12-17T17:23:04Z INFO piecestore upload started {“process”: “storagenode”, “Piece ID”: “MSO4GWFVBHDQ2IO5AW43LB2KP46SP25NI7UQI77LWKTCJ5QXJRZA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 68161612820864, “Remote Address”: “5.161.77.10:45802”}
2023-12-17T17:23:04Z INFO piecestore download started {“process”: “storagenode”, “Piece ID”: “IFWCW7VDU7ZCZFB7KUP5V7H6ICS7OTRVXQNAPLKJUUIE4SCS523Q”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET”, “Offset”: 0, “Size”: 256, “Remote Address”: “79.127.226.98:37728”}
2023-12-17T17:23:04Z INFO piecestore uploaded {“process”: “storagenode”, “Piece ID”: “MSO4GWFVBHDQ2IO5AW43LB2KP46SP25NI7UQI77LWKTCJ5QXJRZA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Size”: 17408, “Remote Address”: “5.161.77.10:45802”}
2023-12-17T17:23:04Z INFO piecestore download started {“process”: “storagenode”, “Piece ID”: “DREJXEZT7NWKWAMQDPSG4G56OW2M7OWJLZHQQD7DWPWWYVNUSBBQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 0, “Size”: 34560, “Remote Address”: “67.159.32.114:39426”}
2023-12-17T17:23:04Z INFO piecestore downloaded {“process”: “storagenode”, “Piece ID”: “IFWCW7VDU7ZCZFB7KUP5V7H6ICS7OTRVXQNAPLKJUUIE4SCS523Q”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET”, “Offset”: 0, “Size”: 256, “Remote Address”: “79.127.226.98:37728”}
2023-12-17T17:23:04Z INFO piecestore downloaded {“process”: “storagenode”, “Piece ID”: “IJOXZUM2LYWITZ6SZAH2WD3SQRIKTHTQ5DCEMPOLMB6KO5UZDQDQ”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET”, “Offset”: 1701120, “Size”: 4864, “Remote Address”: “79.127.226.98:58534”}
2023-12-17T17:23:04Z INFO piecestore download started {“process”: “storagenode”, “Piece ID”: “XK4WNWBRVEUDABPV3IR3F4LCGZ4J4IEVNW7HDBWOPKH7SUAHMKUA”, “Satellite ID”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”, “Action”: “GET”, “Offset”: 2068736, “Size”: 4608, “Remote Address”: “158.180.29.230:50046”}
2023-12-17T17:23:04Z INFO piecestore upload started {“process”: “storagenode”, “Piece ID”: “PI6U3T5AEGSOJACGJSDN6WHLAUKWMLUQTHDTGWYIEYIRYHHOFHOA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 68161612802944, “Remote Address”: “79.127.226.98:58534”}
2023-12-17T17:23:05Z INFO piecestore uploaded {“process”: “storagenode”, “Piece ID”: “PI6U3T5AEGSOJACGJSDN6WHLAUKWMLUQTHDTGWYIEYIRYHHOFHOA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Size”: 12032, “Remote Address”: “79.127.226.98:58534”}
2023-12-17T17:23:05Z INFO piecestore upload started {“process”: “storagenode”, “Piece ID”: “LLFO3F6WUX2X4MCTT4ACR6A6YJVGDOOYSFE4SZBXAZ2QZLHHXKNQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 68161612790400, “Remote Address”: “79.127.219.34:47618”}
2023-12-17T17:23:05Z INFO piecestore uploaded {“process”: “storagenode”, “Piece ID”: “LLFO3F6WUX2X4MCTT4ACR6A6YJVGDOOYSFE4SZBXAZ2QZLHHXKNQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Size”: 2816, “Remote Address”: “79.127.219.34:47618”}
2023-12-17T17:23:05Z INFO piecestore download started {“process”: “storagenode”, “Piece ID”: “OXZ2YIWFIWU2DBNRFCNJKMY2QRL2MVAWGRDFUURTANS2SKPVBMSA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 0, “Size”: 1280, “Remote Address”: “67.159.32.114:59728”}
2023-12-17T17:23:05Z INFO piecestore downloaded {“process”: “storagenode”, “Piece ID”: “DREJXEZT7NWKWAMQDPSG4G56OW2M7OWJLZHQQD7DWPWWYVNUSBBQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 0, “Size”: 34560, “Remote Address”: “67.159.32.114:39426”}
2023-12-17T17:23:05Z INFO piecestore downloaded {“process”: “storagenode”, “Piece ID”: “2KJKZFQS6TLVO246D3O4UUODV2R73WQYE3LJKF3ONRTNQTFZ44XQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 0, “Size”: 56832, “Remote Address”: “79.127.226.97:57936”}
2023-12-17T17:23:05Z INFO piecestore upload started {“process”: “storagenode”, “Piece ID”: “4DSDI2VTTQMCEXHQ75KDXKSGJND37EXKL3QAGYLEEOOQ3AJ5BK2A”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 68161612787072, “Remote Address”: “79.127.220.99:40578”}
2023-12-17T17:23:05Z INFO piecestore downloaded {“process”: “storagenode”, “Piece ID”: “OXZ2YIWFIWU2DBNRFCNJKMY2QRL2MVAWGRDFUURTANS2SKPVBMSA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 0, “Size”: 1280, “Remote Address”: “67.159.32.114:59728”}
2023-12-17T17:23:05Z INFO piecestore upload started {“process”: “storagenode”, “Piece ID”: “HH5ZJGSY4BUUYJIRHREG4UG2ETV5V5C3YLEHEG4MRR4CG45QAIUQ”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “PUT”, “Available Space”: 68161612727680, “Remote Address”: "79.127.203.19
In all the tests, I don’t see any errors, why have the “Online” ratios gone down?
The calculation window still includes dates, where your node were offline, they affect the online score. As soon as the calculation window would not include offline periods, the online score will recover.
To fully recover your node should be online (available to the satellites) for the next 30 days. Each downtime requires another 30 days to recover.
You may check with the scripts above - do you still has offline periods after your change?
This is the result, I have reviewed it and I don’t know how to interpret it
“id”: “1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE”,
“auditHistory”: [
{
“windowStart”: “2023-11-27T00:00:00Z”,
“totalCount”: 63,
“onlineCount”: 47
},
{
“windowStart”: “2023-11-27T12:00:00Z”,
“totalCount”: 82,
“onlineCount”: 57
},
{
“windowStart”: “2023-12-13T12:00:00Z”,
“totalCount”: 83,
“onlineCount”: 65
}
]
}
{
“id”: “121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,
“auditHistory”: [
{
“windowStart”: “2023-11-20T00:00:00Z”,
“totalCount”: 296,
“onlineCount”: 265
},
{
“windowStart”: “2023-11-20T12:00:00Z”,
“totalCount”: 281,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-21T00:00:00Z”,
“totalCount”: 257,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-21T12:00:00Z”,
“totalCount”: 292,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-22T00:00:00Z”,
“totalCount”: 312,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-22T12:00:00Z”,
“totalCount”: 247,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-23T00:00:00Z”,
“totalCount”: 258,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-23T12:00:00Z”,
“totalCount”: 227,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-24T00:00:00Z”,
“totalCount”: 329,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-24T12:00:00Z”,
“totalCount”: 312,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-25T00:00:00Z”,
“totalCount”: 251,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-25T12:00:00Z”,
“totalCount”: 311,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-26T00:00:00Z”,
“totalCount”: 242,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-26T12:00:00Z”,
“totalCount”: 287,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-27T00:00:00Z”,
“totalCount”: 269,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-27T12:00:00Z”,
“totalCount”: 330,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-28T00:00:00Z”,
“totalCount”: 226,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-28T12:00:00Z”,
“totalCount”: 277,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-29T00:00:00Z”,
“totalCount”: 252,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-29T12:00:00Z”,
“totalCount”: 266,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-30T00:00:00Z”,
“totalCount”: 223,
“onlineCount”: 0
},
{
“windowStart”: “2023-11-30T12:00:00Z”,
“totalCount”: 278,
“onlineCount”: 0
},
{
“windowStart”: “2023-12-01T00:00:00Z”,
“totalCount”: 273,
“onlineCount”: 0
},
{
“windowStart”: “2023-12-01T12:00:00Z”,
“totalCount”: 252,
“onlineCount”: 0
},
{
“windowStart”: “2023-12-02T00:00:00Z”,
“totalCount”: 227,
“onlineCount”: 0
},
{
“windowStart”: “2023-12-02T12:00:00Z”,
“totalCount”: 255,
“onlineCount”: 0
},
{
“windowStart”: “2023-12-03T00:00:00Z”,
“totalCount”: 280,
“onlineCount”: 0
},
{
“windowStart”: “2023-12-03T12:00:00Z”,
“totalCount”: 244,
“onlineCount”: 0
},
{
“windowStart”: “2023-12-04T00:00:00Z”,
“totalCount”: 267,
“onlineCount”: 91
},
{
“windowStart”: “2023-12-04T12:00:00Z”,
“totalCount”: 328,
“onlineCount”: 327
},
{
“windowStart”: “2023-12-13T12:00:00Z”,
“totalCount”: 249,
“onlineCount”: 196
}
]
}
{
“id”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,
“auditHistory”: [
{
“windowStart”: “2023-11-27T00:00:00Z”,
“totalCount”: 373,
“onlineCount”: 263
},
{
“windowStart”: “2023-11-27T12:00:00Z”,
“totalCount”: 376,
“onlineCount”: 282
},
{
“windowStart”: “2023-12-04T12:00:00Z”,
“totalCount”: 390,
“onlineCount”: 389
},
{
“windowStart”: “2023-12-11T00:00:00Z”,
“totalCount”: 322,
“onlineCount”: 321
},
{
“windowStart”: “2023-12-13T12:00:00Z”,
“totalCount”: 368,
“onlineCount”: 295
}
]
}
{
“id”: “12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,
“auditHistory”: [
{
“windowStart”: “2023-11-26T12:00:00Z”,
“totalCount”: 1007,
“onlineCount”: 1006
},
{
“windowStart”: “2023-11-27T00:00:00Z”,
“totalCount”: 826,
“onlineCount”: 548
},
{
“windowStart”: “2023-11-27T12:00:00Z”,
“totalCount”: 825,
“onlineCount”: 612
},
{
“windowStart”: “2023-12-04T12:00:00Z”,
“totalCount”: 912,
“onlineCount”: 909
},
{
“windowStart”: “2023-12-11T00:00:00Z”,
“totalCount”: 819,
“onlineCount”: 818
},
{
“windowStart”: “2023-12-13T12:00:00Z”,
“totalCount”: 868,
“onlineCount”: 721
The current 30 days window still includes all these offline events as you may see.
So your online score should recover after 2024-01-13T12:00:00Z, if you would not have downtimes anymore.
After the changes, the ratios are already rising.
Regards
1 Like
Hello guys,
As per the logs “read tcp 10.0.3.2:28967->199.102.71.13:36516: read: connection timed out” that you shared, I believe this is kind of Golang code.
If you don’t mind could you share with me this part of your code how did your code print this error? I’ve been trying this all most a week for a reproduction, but I couldn’t make this error.
I’ve tried with conn.SetReadDeadline but I couldn’t make that error logs it’s only showing i/o timeout
so Could you please share your code that part how did you print that Read: connection timed out in golang?
This specific message is printed out here: storj/storagenode/piecestore/endpoint.go at 87611d0021696ea5c17f0eef6ffe83848756c7c7 · storj/storj · GitHub
2 Likes