Sims can’t leave household without bringing anyone else home

Every time one of my sims leaves the lot while another sim in their household is at work/school, it immediately brings the other sim home from their activity with no ability to send them back. 

Platform: PC

Mods: No

Update: Latest