Lost ability to launch matches with friends Xbox Series X

I don't know what happened but earlier I was gaming with friends and now if I party with anyone else all the game modes get locked and it won't allow us to start a game together.  We figured out we c...