Not much to speed it up, other then building projects. But builders can (and will) become masters just by fixing the current huts you have.

Unless you are close to a population level that would require the next hut, I would not grow your village just for that. It sounds like you have at least two more major construction projects comming up. So stick with it. You'll get several master builders.