I haven't noticed that particular phenomenon in my villagers. I'll keep a closer eye on them and see if there's that much of a preference when they're making choices on who to interact with.