If you want to solve all the puzzles, you're going to have to follow the villagers lead - if they start to do something that doesn't seem to be dossing around (like telling jokes, thinking, etc.) and you're (1) still building up tech points and (2) they have enough to eat, then let them get stuck in.