Definitely watch the population counter....just keep dropping villagers on to each other.. when you see the counter go up you have a new baby... then you can just move the male villager back to his task without wasting time going into the hut.