Well, there are a few things to consider. What are the likes and dislikes of these villagers, for example? Do any of them dislike work or like resting? Does Perl dislike fish?
I've never yet had a villager who would never do ANYTHING. You just have to keep at them and they'll learn after a while.