Ranch Hand problem

I'm on PS4. 

One problem I've had with ranch hands is that I toggle gardening off. Even though it's off they still either continue gardening or it's toggled back on the next day.

I wound up building a locked fence around the garden and having a lock in the greenhouse. I've had it set to "Lock for everyone but household." The ranch hand still comes in. I've also had it set to "Lock for everyone but" and wound up selecting my Sims one by one. The ranch hand still gets in.