Returning from other lot makes all Sims come home from school/work

I play with no mods or cc. For the past few times I have played, if my active sim comes home from another lot while the other members of the household are supposed to be at work or school, the rest o...