Three huts is the maximum you can get, with a maximum population of 90. However, there is a way to get a higher maximum population...
Click to reveal..
If you complete a collection, it boosts your max pop. by 5, I believe, and if you complete them all it gives you an extra... 10? I'm not certain on that.