Sims dont do what i tell them to do

In my sims 4 game I have a bunch of kids in my family some toddlers and some children. My main issue is that when i try to take care of the toddler the parent or any other adult sim just stop what they are doing and go do something else. I'm very frustrated. I do have mods such as master command control center,  and basemental drugs. The mods are all up to date as far as I know. However this has gone on for a long time and I dont know if it has been addressed. I have all the expansion packs except snowy escape and all the game packs except journey to batuu I also have all the stuff packs.