I am assuming you haven't upgraded certain Levels of Technology...

Rest assured, there will be plenty of other things to build/do to increase your "adept Builders'" Skills

Increasing your population will also allow your villagers to build more huts.

I have trained builders to Masters through Fixing Huts but it does take a little while I must admit. But I also noticed that some villagers build up skills quicker than some.