Continuous piece download attempt saturating bandwidth

Node Operators troubleshooting
1

Pretty sure this is for the devs but I have a node thats hit for 1 file 10000s of times. I tried stopping and starting the node but it picks back up. I have this on my fiber 1G U/D and it’s pulling a solid 500Mb/s continuously sometimes going to 900MB/s. Starts cancels and starts over and over sometimes it gets a success as well. This is a snip from the log…

2024-03-30T03:42:20.347043671Z 2024-03-30T03:42:20Z INFO piecestore download started {“process”: “storagenode”, “Piece ID”: “MRKO35NYYMPQ6PTLEIFXTFV7CAL7XHNKUNXOJEGP4U2YDO4UA4HA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 233216, “Size”: 1052672, “Remote Address”: “79.127.205.227:57570”}
2024-03-30T03:42:20.347698400Z 2024-03-30T03:42:20Z INFO piecestore downloaded {“process”: “storagenode”, “Piece ID”: “MRKO35NYYMPQ6PTLEIFXTFV7CAL7XHNKUNXOJEGP4U2YDO4UA4HA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 143616, “Size”: 953856, “Remote Address”: “79.127.201.210:44108”}
2024-03-30T03:42:20.375994945Z 2024-03-30T03:42:20Z INFO piecestore download started {“process”: “storagenode”, “Piece ID”: “MRKO35NYYMPQ6PTLEIFXTFV7CAL7XHNKUNXOJEGP4U2YDO4UA4HA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 206848, “Size”: 1004800, “Remote Address”: “79.127.201.210:45000”}
2024-03-30T03:42:20.377578967Z 2024-03-30T03:42:20Z INFO piecestore download started {“process”: “storagenode”, “Piece ID”: “MRKO35NYYMPQ6PTLEIFXTFV7CAL7XHNKUNXOJEGP4U2YDO4UA4HA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 869632, “Size”: 1449472, “Remote Address”: “79.127.201.210:45008”}
2024-03-30T03:42:20.378254027Z 2024-03-30T03:42:20Z INFO piecestore download started {“process”: “storagenode”, “Piece ID”: “MRKO35NYYMPQ6PTLEIFXTFV7CAL7XHNKUNXOJEGP4U2YDO4UA4HA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 54016, “Size”: 854272, “Remote Address”: “79.127.201.209:38374”}
2024-03-30T03:42:20.381179693Z 2024-03-30T03:42:20Z INFO piecestore download started {“process”: “storagenode”, “Piece ID”: “MRKO35NYYMPQ6PTLEIFXTFV7CAL7XHNKUNXOJEGP4U2YDO4UA4HA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 1399040, “Size”: 920064, “Remote Address”: “79.127.205.227:57582”}
2024-03-30T03:42:20.395237522Z 2024-03-30T03:42:20Z INFO piecestore download started {“process”: “storagenode”, “Piece ID”: “MRKO35NYYMPQ6PTLEIFXTFV7CAL7XHNKUNXOJEGP4U2YDO4UA4HA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 1405184, “Size”: 913920, “Remote Address”: “79.127.205.225:57870”}
2024-03-30T03:42:20.405795401Z 2024-03-30T03:42:20Z INFO piecestore download started {“process”: “storagenode”, “Piece ID”: “MRKO35NYYMPQ6PTLEIFXTFV7CAL7XHNKUNXOJEGP4U2YDO4UA4HA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 869632, “Size”: 1449472, “Remote Address”: “79.127.201.210:45020”}
2024-03-30T03:42:20.444964855Z 2024-03-30T03:42:20Z INFO piecestore downloaded {“process”: “storagenode”, “Piece ID”: “MRKO35NYYMPQ6PTLEIFXTFV7CAL7XHNKUNXOJEGP4U2YDO4UA4HA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 1475328, “Size”: 843776, “Remote Address”: “79.127.223.130:40242”}
2024-03-30T03:42:20.447443667Z 2024-03-30T03:42:20Z INFO piecestore download canceled {“process”: “storagenode”, “Piece ID”: “MRKO35NYYMPQ6PTLEIFXTFV7CAL7XHNKUNXOJEGP4U2YDO4UA4HA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 0, “Size”: 1218560, “Remote Address”: “79.127.205.227:50360”}
2024-03-30T03:42:20.479780475Z 2024-03-30T03:42:20Z INFO piecestore download started {“process”: “storagenode”, “Piece ID”: “MRKO35NYYMPQ6PTLEIFXTFV7CAL7XHNKUNXOJEGP4U2YDO4UA4HA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 262656, “Size”: 1091840, “Remote Address”: “79.127.205.226:38754”}
2024-03-30T03:42:20.532577234Z 2024-03-30T03:42:20Z INFO piecestore download canceled {“process”: “storagenode”, “Piece ID”: “MRKO35NYYMPQ6PTLEIFXTFV7CAL7XHNKUNXOJEGP4U2YDO4UA4HA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 699648, “Size”: 1218560, “Remote Address”: “79.127.205.226:34618”}
2024-03-30T03:42:20.621322541Z 2024-03-30T03:42:20Z INFO piecestore download started {“process”: “storagenode”, “Piece ID”: “MRKO35NYYMPQ6PTLEIFXTFV7CAL7XHNKUNXOJEGP4U2YDO4UA4HA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 74496, “Size”: 874496, “Remote Address”: “79.127.201.209:38382”}
2024-03-30T03:42:20.639825369Z 2024-03-30T03:42:20Z INFO piecestore download canceled {“process”: “storagenode”, “Piece ID”: “MRKO35NYYMPQ6PTLEIFXTFV7CAL7XHNKUNXOJEGP4U2YDO4UA4HA”, “Satellite ID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET”, “Offset”: 1104640, “Size”: 851968, “Remote Address”: “79.127.201.210:43994”}

2

I see the same for 1 node:

2024-03-30T05:30:59Z INFO piecestore downloaded {process: storagenode, Piece ID: LFJFK3GBY53RFWVX4SE4BCZ56H4K3Y5IN36MXK5XQ6YTWBXMQDUQ, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 2236416, Size: 82688, Remote Address: 79.127.201.209:36880}
2024-03-30T05:30:59Z INFO piecestore downloaded {process: storagenode, Piece ID: LFJFK3GBY53RFWVX4SE4BCZ56H4K3Y5IN36MXK5XQ6YTWBXMQDUQ, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 1507072, Size: 812032, Remote Address: 79.127.205.227:42356}
2024-03-30T05:31:00Z INFO piecestore downloaded {process: storagenode, Piece ID: LFJFK3GBY53RFWVX4SE4BCZ56H4K3Y5IN36MXK5XQ6YTWBXMQDUQ, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 1448192, Size: 870912, Remote Address: 79.127.201.210:59222}

Started about 2,5 hours ago, currently 336903 times requested (400GB egress)

Updated 07.17 UTC+1:
Starting to see similar behaviour across 2 more nodes now. Single piece req from multiple clients, different offset and size request. Numbers are the in the 100.000+

3

I also have the egress at maximum bandwidth, it’s saturating the 17Mb I have in upload. I already have 100Gb of egress since this morning.:smiley:

1 Like
4

Nice, customers use it i guess.
can confirm egress spike, only on my new node, so recent data.

1 Like
5

I don’t think it is normal use, as the same piece is started and cancelled again and again:

2024-03-30T09:20:39+01:00 INFO piecestore download started {Piece ID: XQFTXXJ2R5VVGROIYNCYRT7NB4DZRXWQC2V7OWBRFIYBGIMZKKCA, Satellite ID: 12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs, Action: GET, Offset: 0, Size: 5888, Remote Address: 79.127.213.34:42872}
2024-03-30T09:20:39+01:00 INFO piecestore download canceled {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 823040, Size: 114688, Remote Address: 79.127.201.209:60016}
2024-03-30T09:20:39+01:00 INFO piecestore download started {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 90624, Size: 2228480, Remote Address: 79.127.205.226:36550}
2024-03-30T09:20:39+01:00 INFO piecestore download canceled {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 1689344, Size: 196608, Remote Address: 79.127.205.225:38724}
2024-03-30T09:20:39+01:00 INFO piecestore downloaded {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 1689344, Size: 629760, Remote Address: 79.127.205.227:54346}
2024-03-30T09:20:39+01:00 INFO piecestore download started {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 2038016, Size: 281088, Remote Address: 79.127.201.210:59802}
2024-03-30T09:20:39+01:00 INFO piecestore downloaded {Piece ID: XQFTXXJ2R5VVGROIYNCYRT7NB4DZRXWQC2V7OWBRFIYBGIMZKKCA, Satellite ID: 12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs, Action: GET, Offset: 0, Size: 5888, Remote Address: 79.127.213.34:42872}
2024-03-30T09:20:39+01:00 INFO piecestore downloaded {Piece ID: UDHZTEVXIYRIGUPA7KJUD7OQLHLMIIT5WJSMJTBAQON4FTLKERZQ, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 0, Size: 2319104, Remote Address: 79.127.205.226:50092}
2024-03-30T09:20:40+01:00 INFO piecestore download started {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 2298880, Size: 20224, Remote Address: 79.127.201.209:60032}
2024-03-30T09:20:40+01:00 INFO piecestore download started {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 823040, Size: 1496064, Remote Address: 79.127.201.210:59806}
2024-03-30T09:20:40+01:00 INFO piecestore download canceled {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 90624, Size: 196608, Remote Address: 79.127.205.226:36550}
2024-03-30T09:20:40+01:00 INFO piecestore download canceled {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 2038016, Size: 196608, Remote Address: 79.127.201.210:59802}
2024-03-30T09:20:40+01:00 INFO piecestore download started {Piece ID: GTOMNRPPCPLYOFNTEOVOHMFXO7PS3UJVOTQOTYL27X6DDQTCSCPA, Satellite ID: 12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs, Action: GET_AUDIT, Offset: 1447936, Size: 256, Remote Address: 34.159.14.43:19705}
2024-03-30T09:20:40+01:00 INFO piecestore downloaded {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 2298880, Size: 20224, Remote Address: 79.127.201.209:60032}
2024-03-30T09:20:40+01:00 INFO piecestore download started {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 381952, Size: 1937152, Remote Address: 79.127.205.227:54358}
2024-03-30T09:20:40+01:00 INFO piecestore downloaded {Piece ID: GTOMNRPPCPLYOFNTEOVOHMFXO7PS3UJVOTQOTYL27X6DDQTCSCPA, Satellite ID: 12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs, Action: GET_AUDIT, Offset: 1447936, Size: 256, Remote Address: 34.159.14.43:19705}
2024-03-30T09:20:40+01:00 INFO piecestore download started {Piece ID: 3FDBZPV4IMHFUOAOWT377AV5QHUZEPVT3AVHNJSWYYX56DGQIRKA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 0, Size: 2319104, Remote Address: 79.127.205.228:50138}
2024-03-30T09:20:40+01:00 INFO piecestore download canceled {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 823040, Size: 114688, Remote Address: 79.127.201.210:59806}
2024-03-30T09:20:40+01:00 INFO piecestore download started {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 98560, Size: 2220544, Remote Address: 79.127.205.225:38726}
2024-03-30T09:20:40+01:00 INFO piecestore upload started {Piece ID: FO4WAWPCQETBN5JD6XJM2FW2U43D44LIEJ7MUA6GX4SGW2C3RRKA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: PUT, Available Space: 1033550256000, Remote Address: 79.127.205.227:43104}
2024-03-30T09:20:41+01:00 INFO piecestore uploaded {Piece ID: FO4WAWPCQETBN5JD6XJM2FW2U43D44LIEJ7MUA6GX4SGW2C3RRKA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: PUT, Size: 142336, Remote Address: 79.127.205.227:43104}
2024-03-30T09:20:41+01:00 INFO piecestore download canceled {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 381952, Size: 81920, Remote Address: 79.127.205.227:54358}
2024-03-30T09:20:41+01:00 INFO piecestore upload started {Piece ID: RQSOVFNUPJGIFK6QOXXAKCNDPAWCFH2CVVZAC7SR3KCZU4TUB5YQ, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: PUT, Available Space: 1033550113152, Remote Address: 79.127.205.227:43104}
2024-03-30T09:20:41+01:00 INFO piecestore download canceled {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 98560, Size: 114688, Remote Address: 79.127.205.225:38726}
2024-03-30T09:20:41+01:00 INFO piecestore download started {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 1692928, Size: 626176, Remote Address: 79.127.205.227:54362}
2024-03-30T09:20:41+01:00 INFO piecestore uploaded {Piece ID: RQSOVFNUPJGIFK6QOXXAKCNDPAWCFH2CVVZAC7SR3KCZU4TUB5YQ, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: PUT, Size: 181504, Remote Address: 79.127.205.227:43104}
2024-03-30T09:20:41+01:00 INFO piecestore download started {Piece ID: NJAHYQV5B57PRO6MTLIRZNADZWPBJOYYD7C474KMMHJOLI3KFMDA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET_REPAIR, Offset: 0, Size: 37632, Remote Address: 199.102.71.28:56886}
2024-03-30T09:20:41+01:00 INFO piecestore download started {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 115456, Size: 2203648, Remote Address: 79.127.205.227:53882}
2024-03-30T09:20:41+01:00 INFO piecestore download started {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 96768, Size: 2222336, Remote Address: 79.127.205.227:53884}
2024-03-30T09:20:41+01:00 INFO piecestore download started {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 2038272, Size: 280832, Remote Address: 79.127.201.210:59818}
2024-03-30T09:20:42+01:00 INFO piecestore download canceled {Piece ID: 2RWTSB6AWUZOTUJGOZATXNATFDWL5DROWCB2XIVMFXI2K5KCEDQA, Satellite ID: 12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S, Action: GET, Offset: 1692928, Size: 196608, Remote Address: 79.127.205.227:54362}
1 Like
6

This is absolutely normal (for the reference - any customers’ behavior is normal), just your node is too slow for that customer.
But you cannot win all races and be close to everyone customer in the world.

7

Thanks for the feedback @Alexey

In that case, my best guest based on a bit of Grafana digging, would be that a large customer is distributing data via STORJ.
This traffic pattern could resemble precaching of something to a CDN or similar.

However, if my guess is right, it would also indicate that the current data distribution design in STORJ, is causing some nodes to overload or at least saturate their ISP connection.

In other words, high traffic uploaded files, does not seem to be split between enough nodes.

I see the traffic on ~20% of my nodes.

Traffic seen on my end:

image
image792×357 47.3 KB

I’m aware that this is not based on facts, but only assumptions - however, it might raise a point for internal discussions.

8

Did not see anything like that on one of my nodes.

There is this idea of scaling “hot” files: Issues · storj/roadmap · GitHub

1 Like
9

How could it be normal when the same piece has successful downloads as well? Over and over and over plenty attempts to download were accomplished and then it would download again. I’ve had 400GB+ of egress today on a new node with only 124GB of data. Not that I mind getting paid for the egress but unusual it is. It has slowed to 1/10 of what it was but the same piece is still going…

10

I just want to point out its impossible to saturate bandwidth with only one file. In order to saturate you would need more then one node running. Its not 900MB/s its more like 103MB/s for 1gig internet. In order to hit 103MB/s the file size would need to be at least 100MB each and there not. There more like 1MB to 2MB files.

11

Isn’t this normal traffic? A client is requesting different offsets+sizes… and the node isn’t winning every race.

For the data you do win, enjoy the egress payouts!

12

it’s quite possible. However, these nodes will be cut by the long tail cancellation cut (the customer will request 110 unique nodes to upload, and when the first 80 are finished - all others will got canceled).

13

why not? How you could predict a customers behavior?
They are - real people, not some computer.

14

not necessarily. Your node has only 1 of 80 pieces of the segment of the file, so doing any assumptions it’s like a finger to the sky.

15

No its not possible to download 2MB at 100MB/s period…

16

It is, you just don’t need a full second to do so.

17

Then its not 100MB/s…

18

If you are travelling at 100km/h, how many km would you cover in 5 minutes?

19

Have you ever downloaded a 2MB file and it saturate your internet? No. It would take 100+ files of 2MB at the sametime.

20

Yes I have actually. Here’s an rsync I’m currently running:

11,008 100%   10.50MB/s

That’s a 12KB file downloaded at 10.50MB/s. It just didn’t take one full second, as I said.

1 Like