Males don't get too old to breed; as long as you have that one woman farming for the children when he dies, and you aren't in a food crisis, you should survive; just make sure you get at least one boy- and one girl-child out of that union, and preferably more pairs.

I suggest using women as parents in slow-growth situations; they ensure childbirth will be staggered, as well as slow and even growth, even when there are lots of males around.