Hi,
I've found that putting the game on 1/2 time when I'm going to be away for awhile also helps. I had quite a lot of villagers when I did not have fishing (can't remember exact number), but when the crops were ready to be farmed I would help the farmers along so they would dod this quicker (by dragging them there for a while) and build up some food in reserve for when the crops are growing. The berry bush grows some more as well after it has been emptied. And there are always the mushrooms! Maybe I am not such a great example, because all my villagers ended up being weakened with starvation...however this was corrected once I had fishing and they never looked back! : )