I've had the same trouble. I put the chief on, he does his funky weather dance then i've added about 10 villagers. They do the dance then they all go about their regular business. I've got level 2 leadership and level 3 nature.