I had that when I was at the beginning of the game I decided just to have one villager parenting and gass what, when I got back to my game 3 of them were caring for babies.