Changing your settings to easy won't make any difference. When the game is running, changing the game speed also won't make a difference, only when the game is closed. The only sure-fire way to speed up the building is to put more than one builder to work. If you can't afford another villager to put on building you don't need the hut in a hurry as you can't afford to increase the size of the tribe yet, anyway.

Thanks for much for all the advice!
I guess I thought I needed to build so the hut was done before they got to old to have babies.

In VV1, there is no limit of age to have babies!! (in VV2 it's 50 y/o only for females) I had a villager who was nursing at 75 y/o!!
When you'll need to have 1 kid more to collect mushrooms, it will be easier to do it if the hut is built!
I had to do it once and I made my 2 villagers kissing so much that the female was near to be master parent before having any baby!! She had a baby as soon as the hut was built!!