Rivals not working (your player has left the match)

Hi, I am unable to play rivals. Every time I start a match and find a player,  after about 15-20 seconds, a pop-up shows 'your player has left the match'.

It happens almost 90-95% of the times, and it has become impossible for me to play rivals now.

Sharing video for the same: https://youtu.be/8zY6jAg1TtA