Anyone Else Feel Guilty About Changing a Sim's Genetics?

I leave my genetics as is because I like my families to look natural and related to one another. Getting an ugly sim gives me more diversity and a bit of a challenge to see if I can find them someone to breed out the ugliness. It feels like an accomplishment if I can manage it, and makes gorgeous natural-born sims more worth it.

I usually feel bad about changing hair color unless it's one of the colors that the parents had because I know that color genetics aren't locked in like in previous games.