Trading villagers between games might be hard to program.

Basically the game create new villagers for you to "recruit"
Thw wharf create rafts which remove or create villagers.