How do I stop my sims from picking up their toddlers for no reason?

Most Sims can't seem to help wanting to interact with their children.

If this is bothersome, do something to engage the child like placing some toddler books on the floor and direct the toddler to read. I have not seen a parent interrupt a reading toddler when the player directs them. Or, direct the child to play with some of the toys in the toy box. As long as you gives the toddler something to do, the Sims (to my knowledge) will not override it. They may cheer for the toddler but, they won't interrupt them.