There are other tasks for the builders that are not only to build a hut! And it will increase the builders' skills!
SPOILERS:
You may also put them to fix (but not to examine) the hut, it's long but it helps!!