RE: Fill Empty Homes removal?

So, big question time. I don't do the story or scenario things. But, I do like having all the home eventually fill up with randoms. Am I now poop-out-of-luck? Seems like a bad move to me. Or is the o...