Missing/wrong interactions for Infants on Playmat

So in recent games I've noticed that when I put the infants on the playmat (this happened with 3 different infants), they immediately call the caregiver and the caregiver abandons anything I queued u...