Keep getting disconnected In Ultimate team

This is very frustrating. Whenever I start a match in Ultimate Team especially in division rivals, the connection to the match is lost constantly. This is happening only when my opponent does not skip the lineup cutscene. If me and my opponent both skip the cutscene, the match plays to completion but then if the opponent doesn't skip the cutscene, when the match starts the fc logo keeps loading below the radar and after about a minute or 2 I the lost connection message appears. This is frustrating because when I enter ultimate team again it shows the DNF message and I slide back on my division rivals progress  as if it's my fault. What could be the issue really?