When you switch difficulty levels mid-game it changes how difficult the game is after the change correct?

So if I started a new game under Hard, then changed the difficulty level to Easy and did NOT hit the Start Over button, I should have the game to how it's intented to be? Right?