They won't go to the flowers voluntarily once they are adept doctors (at least I've never seen it happen!) Its tedious work but pick them up and put them on the flower over and over and over and over and over....

Or make a certain stew that makes people sick....

PS. They can become Master builders after everything is built. They fix huts, over and over and over....