WHEN IN PARTY, THE PARTY IS UNABLE TO JOIN ANY GAME MODE

When i am in a party, the party is unable to join any game mode. Once I leave party, party is able to join game then they have to invite me to game, but normally get stuck in a queue until spot opens. I am on xbox series x