The villagers want to do less stuff in each different difficulty, also it seems you're more likely to get a harder events on hard and stuff.