Don't worry I have a village who likes fish but hates blue; he refuses to fish and won't swim. By far the most annoying villager is the one who hates lifting and working so he doesn't want to do anything. I flagged his breeding skill and he runs away from every female in the game; if he gets sick I'm not letting the healer anywhere near him. Stupid lazy villager.