Replays shown while opponent can keep playing

My opponent kept pausing the game and when unpaused all I kept seeing was replays while my opponent is going on to keep putting the ball in the back of the net on ultimate gauntlet which is making me miss out on rewards and skill points