My villagers tried the same thing, I just kept taking them away from the trees and putting them in the field. They soon get the message....