Can't quit to menu

Sometimes the game just say no and won't let you quit to menu at all. sometimes its the first match and other times it doesn't happen at all while i'm playing. There isn't any indicator or set of situations that causes it that i can tell.