I've found it much easier to train builders using the pile of rubble, down by the bath area. They only have to go a few feet back and forth and you can easily keep track of your villagers down there, and quickly get them back on task as soon as they say "no". They seem to get the hang of the work much more quickly, too.

I now try to save the rock pile until it's the last thing to do for builders, except for the Clothing Hut. Only newbies work on the clearing the rubble & as soon as they're trainee level, I then put them on whatever building project the others are working on.

I have trouble keeping them working on the rubble; the roster of the dead is more helpful to me. As you said, walk-time is short, and it's very good training for securing the grove later.

I save the clothing hut and rubble till after the Statue is done also. Usualy the rubble is the last thing I do. This gives me something for builders to work on if needed for statue.

I like to have the time to concentrate on the rubble tiles, and keep them building. They love to try to run off! LOL