actually, it would be just the opposite. Earlier generations would probably have a harder time. Once the population grows, as long as more than one male is doing the reproduction, the chances of immediate relatives procreating would decrease.