Perhaps surprisingly, my villagers are much better farmers when my Palm is off. If I leave them alone and just let them farm or fish for a few hours, it seems to go much better than if I try and micro-manage them. I think they resent the dark hand of "the man!"