Why are players able to kick you off the game.

Keep getting kicked off playing rivals. This is costing me points and games. Why are other players able to do this. Why is nothing been done about it