I find that once I have a large population and I put one in three villagers on farming there is no problem with food production. Try raisng your population to the maximum and play with a percentage of farmers that you find works best.