How do I stop my sims from picking up their toddlers for no reason?

I know this thread is old but I can’t seem to make a new one and the title fits my issue. But anyways, my adult sims go out of their way to pick up their toddler for NO REASON AT ALL! I do have autonomy on, but both the kid and adult have things in their queue that I set, why would they go off and do something else? And they always glitch out and reset a few seconds after the adult picks them up.