Perhaps if you keep breeding him back to his daughters you will get more of the same? (It's not illegal in Virtual Villagers, although you obviously wouldn't want to try it in real life...!)
I have an interesting village - everyone died out apart from three men and one woman of breeding age. I made one male only an adept parent, to restrict the gene pool. I now have a village where everyone sounds the same - each child says "ee" when they are picked up, and each adult woman says "oh" in the same way, and each adult male says "Hey" in the same way.