No, it's random. Just keep breeding them if you can feed more people (and have housing).

Even they don't father any sons, don't give hope.