Not completing the Infant Task

I have asked my Sims to do a task with the toddlers, but they refuse to do them. They won't feed them, change them, or interact with them at all. Sims will pick up an infant and place it back on the play mat.