Going from full lobby to empty server, again..

So I had this problem when the game first came out, and now after the last patch its happening again.  I'll join a map,and after the two rounds are completed, I'm moved to an empty sever that is out...