It's normal! The berry bush continues to provide fewer and fewer berries per basket as your villagers harvest the berries. After the berries are mostly gone, they will get only 2 units of food per basket.