Getting event(s) early in the game where a villager disappears or they get sick or die may cause a village all of the same gender. I started over once when that happened to me, but that was before I read about the "Hard Tribe." I may try the recovery now...