Are you sure you've tried absolutely everyone with the robe? I find it helpful to go through the villagers one by one with the Details screen, to make sure I don't miss anyone out. Also, if there is a nursing mom in your tribe, she (or her child) might fit the robe, but neither can try it on until she's stopped nursing. Good luck!