First make sure to have the box checked for construction on the villager detail screen. I would put one or two on the beach detail. Look at each villagers detail screen and put the two highest builders on it. It will not take to long for two of them to get it done.