I had my speed set on 2x and had about 30 villagers, with about 4 farming and just let the rest of the adults research with one or two doctors just in case. They rake up the points pretty fast (well, overnight that is).