Yes, you can only have 50 elders/totems. There is a specific event that will make you have another elder, but it's pretty rare to get it happen just right.
_________________________
And what if it makes you laugh now but you cry as you fall asleep?