They can use the torches for a couple of things. You have fire and have dropped adults on the torches - have you given the villager a moment to try an idea...or something like that?