Lost ability to launch matches with friends Xbox Series X

I don't know what happened but earlier I was gaming with friends and now if I party with anyone else all the game modes get locked and it won't allow us to start a game together.  We figured out we could solo que and once a match is found join on each other but once the match is over it won't take us to the next match, we have to keep doing the solo que trick every single time to get into matches.

Everyone was on Xbox Series X, everyone had an Open NAT, everyone was playing with crossplay turned off.  Although we tried it with it on, still didn't make a difference.