the only thing to do is to put your villagers on the huts and to make them "fixing the hut" (not examining). When a villager makes exercice, he improves his buiding skills (if he succeed) a little so you can make a stew that makes them exercice.

PS: clearing the thorns and the vines gives them some building skills, if you didn't already make it