Yeah, it's quite normal, my builders started building a second hut on their own when i had approximately 12 tribesmen.

And, i'd like to mention that you can train a builder anytime fixing a hut, so you won't get stuck w/o builders. Some of my people from time to time tend to go fixing hut, which is above the food storage and used by tribesmen to have sex...