Put into an empty lobby after every match.

When starting the game, it puts me straight into a match. After the match ends it puts me in an empty lobby and need to wait for it to fill. I find it hard to believe 32 players are leaving after each match. If I exit the game entirely and start it again it most of the time finds a match immediately.  How are the servers full but lobbies are empty?