I save the clothing hut and rubble till after the Statue is done also. Usualy the rubble is the last thing I do. This gives me something for builders to work on if needed for statue.
I like to have the time to concentrate on the rubble tiles, and keep them building. They love to try to run off! LOL