It's likely that the females all had some breeding skill (a villager will often do anything that they know how to do, whether you select that skill or not). When a female chooses to breed, they will seek out the alpha male of the tribe, which is why all the children have the same father.