They may not appear for 1 or 2 minutes after the chief finishes the "magic." I've read that many people pause the game to try to give themselves more time to look for the rare collectible, but that will likely prevent it from appearing. New collectibles do not appear in VV3 when the game is paused.