Oddly, I also find myself particularly attached to villagers who have negative dislikes; ones who hate fish, or turnips, or running. Those who succeed in becoming masters or Elders in spite of their dislikes I kind of admire; it's rather like admiring those who succeed in life despite a disability like blindness.
Wow. That was so inspiring. It's the same with me; I've got one guy who has a bad case of teenage angst, but he's got tons of skill in multiple areas. Elder someday? It'd be kinda ironic, but cool.