I only make three changes to their clothes - orange for the buliders, green for the farmers and black or black and white for those who should be at the research table. It hepls me keep track of who should be doing what and as tbug mentions it means the villagers become skilled a lot quicker.