The collectibles do keep appearing but you need to constantly keep an eye out. Also, if you have Level 3 Leadership, the Tribal Chief might be able to help you locate some of your missing rares if you put him at the top of the path near the door every 24 hrs.