I do remember it took a long time, but I don't remember it being annoying, because it was mostly when my village was closed down. How long has it been so far? (Days, not village time) and what speed are you on?