I think a lot depends on how often and for how long you pause the game; it seems to throw off the clock. Sometimes the countdown seems to stop completely for a while after pausing and restarting. I don't have any real evidence for this, though.