Invites in game

I was in a game, received an invite while I was playing and as I tried to do a reverse hit at the exact second I received an invite, I got kicked out of the game and joined the invite.

At first I was wondering what the hell is going on, upon review I saw that I received an invite, but never saw it when I was playing.

Way too easy to join a game while playing, it always should be a notification to review when the play is not active.