It really depends on what needs to be done. If you haven't finished the puzzles nad bought all the techs, villagers should be allocated to those ends.

You should always have a few Doctors, or at least several villagers able to heal.

It is also agood idea to keep villagers trained to farm, although you can have them primarily researching or building. That way if something happened to your food supply, the villagers can still survive.