That has happened to me when sometime if I picked up a male villager made no sound. Then when I closed the game and opened it, the males sounds are back. At an other time it has happened with the female villagers. Once I restart the game then the sounds are back.