Unavailable with Party

When in a party with one or more friends, there's a big where the host is unable to select a game mode to play together. If the host is on the main menu and invites a friend to join their party, all multiplayer game modes get locked out with the error message "Unavailable with Party".  The only work around we found was clicking on the game mode first and going into the pregame lobby screen where the (+) icons are shown at the bottom of the screen to add more players, then inviting from there will allow you to host a match. However if you invite more than one player, it can still lock out the mode and inviting players in a certain order will keep the mode from locking out. This happens each and every time when trying to form a party. 

I play on Xbox Series X as well as one of the players I was trying to party with.