Did you built the first hut? The one with 50%. If not, then the max number of the villagers is 7