In hard mode you have 5 villagers instead of 6 or 7 in the easier modes, no automatic builders, and the villagers consume more food.