Time changes when traveling back to lot

Hi, I recently started a new game with a new sim. I loaded my sim into the selected lot, like usual. It was 9AM when my sim arrived to the house. I had him travel to another lot, he stayed there unt...