I've got a builder who dislikes wood, so he won't build the hut. He also dislikes eating. I suppose that's not a bad thing as he probably won't keep eating the village's supplies. I've never known a builder who hasn't got a hearty appetite, though!
I had a builder who disliked wood but I still got him to build the hut most of the time and become a Master Builder.