In another thread someone suggested pausing the game, getting everyone to the robe, taking the game off pause and trying that way so they're all in that area at least.