There are lots of discussions about that situation in the both of the VV forums. The genders of the babies are random, and sometimes there is an imbalance (just like real life). It will eventually even out. You have to be more careful in VV:TLC, however, since females can no longer make baby villagers after they reach age 50.