There will always be a rare collectible somewhere on the map, but not usually in the direction that the chief appears to point. Once the chief has finished his magic and does the "pointing thing" just start looking everywhere.