Because there are other things for them to do other than polishing. They choose activities randomly out of what's available. The game does not save what you selected for them to do before you exited the game, so putting them on the statue and then exiting is not going to help them stay on that task. When you open the game the next time, they will probably have chosen to do something else. Even having "building" selected as their preferred skill doesn't mean they'll only do building activities, just that they're more likely to do them.
_________________________
Runners... never enough runners....