In general, you'll need level 3 of the various techs to complete the rest of the puzzles. But in addition to that:

Getting Level 3 of Science is useful since that means that each research session will earn more points.

Level 3 of Medicine will help your villagers live longer.

Watch to see where your villagers are exploring and each time you upgrade, bring various skilled villagers to that area.