I generally take masters OFF their mastered skill, to cross-train them in multiple masteries, unless I'm in a pinch. But yes, a master of a skill does do better than other villagers, though being an elder grants no benefits beyond mastery.