Slow successful uploads

I’m seeing very slow uploads on europe-north test uploads It started taking about 5-15 seconds per piece when the tests started last week, but since yesterday I’m seeing longer upload times on traffic coming from this node.

For example:

2020-06-29T22:08:24.217Z        INFO    piecestore      upload started  {"Piece ID": "B2O54PYCCAIATQUXKWY3GHMZATH2DAT47I67D3DH3WBKUHLJ53QA", "Satellite ID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB", "Action": "PUT", "Available Space": 3372202320512}
2020-06-29T22:16:43.351Z        INFO    piecestore      uploaded        {"Piece ID": "B2O54PYCCAIATQUXKWY3GHMZATH2DAT47I67D3DH3WBKUHLJ53QA", "Satellite ID": "12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB", "Action": "PUT"}

The piece is successfully uploaded - so probably not a slow system issue or HDD bottleneck, as the upload race is not lost. Also, uploads from other satellites are, in general, faster (when system starts having issues with lots of threads waiting for IO, it becomes slow for all uploads), and downloads are in normal speeds from request to successful completion.

Am I the only one seeing those slow uploads?

If it takes that long and isn’t canceled, that has to mean the bottleneck is on the customers end. This customer likely has a slow connection and takes a long time to upload files. Or they are uploading a lot of files in parallel. Either way, it’s fairly normal behavior and doesn’t indicate a problem with your node.