Sims are coming home early from work or school

Every time I go into CAS mode my other sims in the household that are in work or school come home early and I can't send them back. This also happens when I save and quit and reenter my game. I also notice that my infant's milestones get reset but the game still allows them to do the previous milestones they accomplished on their own even though it does not show on the milestones tab and there's no options to help them do it (for ex. my infant learned how to sit up but once I enter CAS or reenter my game after a saving or quitting the milestones disappear but my infant still sits up, however I can't feed them on the highchair as it says I haven't achieved it) Is anyone else having this problem and has a fix to it?