Infants don't show milestone progress when visiting from another household

I have noticed when I am playing the grandparents in a different household that infants don't show that they can sit up or crawl anymore when I have them come visit. When I switch to the household where the infant is they crawl and sit up. Screenshots are from where I moved them into a fresh save. No mods enabled.