Are you sure that you paused the right game? The pause feature only works on the game slot you're in, not all the slots.

Plus, pause is actually just e x t r e m e l y slow.
It's possible that if your family members were on the verge of the starving mark, they might have moved into it while you were gone, and then that may have started moving the health bar down.