Invitations can kick you out of your current match

If a friend sends you an invite while you're already in a game, it can boot you from your current game and put you in a squad with said "friend". Thing is, you don't even need to press "Y" for it to happen. I was mid-air gliding from baloon when it happened and so the only key I was pressing was "W" and there was no pop-up/notification for an invite. I was just suddenly "dropped" from my game and sent back to the main menu in a squad with said "friend" that (I would guess) sent me an invite. 

This is EXTREMELY frustrating, plz fix.