Adults/teens/children at work/school on reload trying to skip work/school

One of my sims is a mixologist and works at night and I cannot travel with my other sims without him coming home from work early with no prompts asking. And vice versa when hes home during the day and theyre at school/work. I travel to the bar and he ends up at home ending his shift early. Just started happening to me today :(