The farm has only a certain amount of food with each crop, so if you have a lot of farmers harvesting the crops, it will be empty sooner. The ocean never runs out of fish!

Once all of the construction puzzles are complete, fixing huts is the only way for your villagers to gain construction skill. It does take awhile.
