Normally, I have at least two on food once I have over 6-7 villagers. Farming will sustain you for awhile, but fishing is essential for a large village. Keep 2-3 farming and the rest on research and you should be just fine!