Time travel should not effect the game if the game was paused before and after time travelling forward in time. The game should just think it was paused a week, instead of paused an hour. Time travelling backwards in time has . . . unpredictable effects, but usually not killing villagers.