No, you do not need to wait to finish collecting all the tablet pieces before clearing the rubble. Just keep a watchful eye on the rubble area for the missing tablet pieces to appear. They appear very, very infrequently so don't be alarmed if you do not see any for a long while. Only the missing ones will appear.