Changing Everything About a Child Sim When I make their teen versions

I've tried it without mods and it still happens, it's a very weird occurrence, the thing is, I don't change the face or really anything when I make the child a teen or adult, I keep everything how it is and just change the clothes and hair, but what really ticks me off is that it removes my viltigo on my sims when I age them up?