Sometimes your villagers don't like certain others! I had a village that wouldn't breed unless the PDA was turned off. I would wake up and have a sea of babies...
Keep on them and eventually, you'll get more babies.