That method works well, but has its pitfalls. When you drag a lot of villagers to the same place, sometimes they interact with each other and not with the hotspot. You need to keep a close eye on any villagers who move away from the robe too quickly, since they might have been embracing or telling a story or whatever. That could explain why people say they have tried everyone and not found the chief.