Male sim voice changing after triple speed

Everytime I load into my save my male sims voice is deeper, which is how it is set. However, after playing a few minutes his voice will change to a higher female voice after triple speeding. I have tried saving and going to different lots to fix this but it still stays that way. Only solution I have found on fixing this is to close out of the game and relaunch. But it is a temporary fix, after a few minutes it still will change back into a higher pitched voice.