As the villager becomes more experienced, the changes in his/her bar become smaller and smaller. Yes, (s)he is gaining experience, you just have to be patient and eventually you'll get the skill mastered.