Xbox Party Matchmaking Bug

I have about 5-10 guys I play with, and for whatever reason about 30% of the time it will not pull me into the match with the rest of my party.  

Is anyone else dealing with this?

Interestingly this started happening in 2042, so I think theres an account related bug specific to me.