Why are only Challengers servers good?

I never have any connection problems when playing Challengers.

Then when I play Rivals, 1/3 of the connections are terrible and I have to search for a new partner. Clearly this is just a server issue so fix it EA.