Did you happen to leave it on the menu screen when you paused it? If so, you didn't really pause the game. The game speed settings don't take effect until you return to the main game screen or exit the game.