You have to put your tribe chief on it first, then put every available builder on it. With your leader there they'll start to push it. But keep an eye on them because they wander off from time to time.