I think that if you change the difficulty of a tribe, you have to restart the tribe! When you start a new tribe, it will be at the last difficulty that you have chose before.
The "normal" difficulty is the one that is set at the beginning.