From my understanding, you can get over 50 totems by getting an event where you choose a language and a mirror breaks. But you need to have an esteemed elder alive. If you reach 50 and they all die without the event taking place(like myself), then you can never get a 51st.