The only thing that will cause the food to grow is time. Have you checked the berry bush to see if any berries have regrown? That can help a little. You don't say how many villagers you have, but this kind of problem with food usually happens when you grow your population too much at the beginning of the game. They are eating too much food too quickly.