Babies taken away while not playing the household?

I'm in shock. I just entered the main estate of a dukedom. They had a baby born while I played other houses, and it was time to check out the new addition to this family. Finally a boy, which means a...