Visitors won't leave?!

Is anyone else having the issue where a friend will come over to your house and just. never. leave. It's so annoying! The "Ask to Leave" interaction isn't even available. I've tried luring them outsid...