It did finally work. I started placing the villager (male) slightly above the elderly female, so that it was easy to grab and drop him again. It does get very, very slow at the end.