Since writing, I've dropped many villagers, of all skills, onto the encampment. No results at all.  Is there a special spot to put them on?  I've tried the mud hut, the dead fire pit, all around the edge...everywhere.  Does everybody but me get a flower garden?   
