I wish I knew how it was happening so I could do the opposite frown

Please tell me if my method is sound to make SURE its not just me.
Click to reveal..

I have ALL tech researched. This is my last necklace piece. All totems are down. Everything is built. 2 blue Heathens left, should convert sometime today. I am using master builders, my first try was with a Jack of All Trades, but he has since died. I am waiting for the purple builder to be in his area, then bringing my villager over and placing him/her nearby. Once I am ready, I use the power on the villager and grab him/her as soon as I can and place him/her on the challenge. My villager starts the challenge, but then leaves to do other things and I am right back at square one.
Does it seem like I am doing everything I should be doing? I honestly can't figure out where I am going wrong if this is an error on my part.