Party not staying together during next loading match.

On Xbox Series X. As the party leader everytime my party and I play together at the end the match my party members get kicked back to the menu while I remain loading into the next match. And all their screens say is waiting for party leader on the lower left side. It never connects them into the next match with me. So we end having to back out and always put into a mid game match. Very frustrating and annoying. Again we are on Xbox. We DO NOT have crossplay disabled.