If the scaffolding is still there, you should be able to train new builders using the debris left on the beach by an Island Event (one should come along sooner or later) and then continue work on Puzzle 12.