Join Party but not Join Game

This is another ongoing bug. I can be in a party, my friend will join the game, but I will remain in the lobby. He leaves the game, and then it sends me into the game because there's a free slot.

What's the point of party if you're not joining the game?