Your opponent has left the match, Rivals

I find an opponent right away, I select both jerseys, hit advance but the timer just goes to about 7 seconds left and I get the message that your opponent has left the match. It has hayover 10 times ...