I decided to train one of my men in breeding. I came back 2 hours later, and he had fathered 8 offspring! So then I decided to train some new fathers, and rotate them to mix up the gene pool. None of my villagers seem at all monogamous.
I can't keep track of who fathered who...