In my experience 50mbit is usually enough to do ok, latency becomes more important which is often location dependent. Where are your nodes located (country only is fine)?
Might be useful to run this script to see how your nodes are doing on success rates!
That would show if there is an issue with “losing races”.