More players in a challenge than in the party, causing game error. 305594340

Same exact issue as you guys, game kicks my party of 2 off if someone leaves, and there's been random people in every challenge we've started in the last couple hours. Really takes the fun out and interrupts what is an otherwise pretty solid experience. Both of us are playing on Xbox Series X.