You're not doing anything wrong, but being patient might help. This isn't a game that's designed to be finished in a day. The most important thing is to manage your villagers and their resources wisely as you work toward improving their skill and solving the puzzles. There's a lot to enjoy in the game.