The difficulty levels do affect the game in a number of ways. The main effects are in research ability and food production/consumption, which can dramatically affect how well your tribe survives and advances, but there are other effects, too!