Check their health status too - sometimes a weakened status or elderly status will make them actually take forever to get to the Village Center (also if they dislike crowds they wont participate in parties either)