I restarted the game once, but both times the first they did was the green one on the left. I kept plonking them there and voila. Actually the first game, the one I restarted, I used different villagers for the plants and it still worked. The second was the fruitless plant, then cactus, then the others.