When you opened the crate and you had a villager pick it up, they carried it away and stored it for later. Once you solve a particular puzzle, that piece will show up along with any others you have found. If the crate is gone then you have nothing to worry about. It will show up sooner or later.