Random townies entering house

Since the most recent update I've had every sim just able to enter my house without being invited. It's random townies that my sims have never met. They don't knock or show any pop-ups about visiting, they just walk in. Then they either sit and play on the computer for hours on end without ever saying goodbye, or they bake white cakes autonomously over and over.

I disabled mods and it hasn't changed anything. I've messed with the trespassing settings on the front door and it doesn't matter. I don't want to have to lock the doors because I want their family members/friends to be able to get in. For now I just have my sims introduce themselves and then immediately send them home, but it's inconvenient and I keep finding cakes everywhere, lol.