Musical Chairs...Butler Edition

Does anyone else have trouble making their sims retain the same butler? I seem to have a pool of butlers that switch between various households that employ their services, and they don't only switch ...