What I did to get the heathen guard away from the hungery totem was I grabed my kid & kept dropping her in front of him till I had lead him to the bottom of the screen, then I pulled her away so she didn't lead him back & I dropped all my adults on the totem, then I repeated the leading him away process each time he got about halfway back to the totem till it was dismantled.