It's usually worse than time-travelling forwards. Villagers will lose skills, food, tech points, advances and puzzles will be lost; all sorts of bad things can happen.

Simple answer: DON'T EVEN THINK ABOUT IT!

There's a long sticky thread already about this: Gentle warning for time travelers....