What is your game speed setting? Do you have the preferred skill set for your villagers? They gain skill much better if you set a preferred skill.