Match lag when viewing from the sidelines

While waiting for a match to start (which took ages due to not enough people in the server). The game in process seemed incredibly laggy/jerky, as if frames were missing from the player animations.  

Xbox series X