As with previous VV chapters, you can build 3 housing huts in your village, and no more. The 'trigger' for additional huts is not the same as in the previous games, though, and has confused a lot of players. Did you get this message when you tried to make a new baby villager? If so, then you haven't built all of the huts yet.