You might find the herb map helpful. We've never seen a case where the villagers would not gather the herb when placed in the correct place. If you hover an adult villager over the berries, you should see a message indicating that you're in the right place.