Butler Issues

I'm having problems with my butlers. I cannot get them to stop gardening - I give that direction - all family members give that direction - butlers still garden. Butlers change. I start a game with...