If you have 50 elders, you've reached the limit in the game. There is a lot of discussion in the forums, both pro and con on the subject. If you do a search, I'm sure you'll find several threads where you can join the discussion.