Sims look like adults while still being a young adult

So most of the time when I'm playing with young adults, if I switch outfits, move houses, or even just go out to a different lot, my sim will start to look like an adult Sim without aging up. Does anyone else have this problem or know how to fix it?