It only happens in my game when the "Appearance Time" for the Collectible has expired.

I've only had problems with Gems in the "Ancient Place" and I've been told that the Experts will be sorting out the problem.