I've had 50 Elders/Totems many times in the iPhone version. Don't forget that you continue to make new villagers as old ones die, and they can all work on becoming elders.