SIms 4 Business & Hobbies Customer Sims Won't Leave / Enter Residential Area

I started a new save and decided to open a small business attached to my sims house, 

Within a few hours I noticed that whenever I closed the business for the day, a random customer would suddenly get trapped or would find their way into my sims actual house. The customer sims would no longer have the red "Customer" label above their names either.

There is no way to get them to leave.
There's no "send home" option, there's no "ask customer to leave" option.
I have tried adding these random sims into my household, teleporting them away, then removing them... But they always just naturally find their way back into the business / residential areas. 
Doesn't matter if I lock the doors or gates to the business/residence.
They almost act with roommate functions, coming and going freely without the ability to control them.

Since there's not even an option to delete sims to just remove them outright, I end up having to bounce back my save to before I opened the business for that day every single time, losing whatever progress I had made in game otherwise.

Within one hour of playing, this issue happened twice with two different townies.