Sims stop doing their activities if the active Sim leaves the lot

Sims stop with their activities when I leave the lot with a Sim. Even if I'm only gone for a couple of seconds, they are doing something entirely different than they were a moment ago.

This leads to homework not being done or finished, Sims getting out of bed even though they were sleeping, and them doing something entirely different and not caring for urgent needs.