it can be done

it just takes a really really really really long time

it can take a lot of manual manipulations before anything changes

the only other thing I can suggest is to check building next to your villager and turn the game off for a few hours

check your log to see if any building progress is being attributed to your villager

i think they should still fix the huts while the game is off
_________________________
Why is it that if someone tells you that there are 1 billion stars in the universe you will believe them,
but if they tell you a wall has wet paint you will have to touch it to be sure?