Sims not mourning family members death unless they see it?

Happens to me a lot. I tend to try and have twins or triplets and only keep my "fav". The others and the dad usually get fed bad pufferfish. If I feed them while the keeper kid is at school, they never know. You would think they would wonder but...sim world.