The collectibles will continue to appear, even after the puzzles are complete. The two factions are mutually exclusive. In order to play the other faction, you will need to start a different tribe.