I play VV since almost two years, now and I can tell you:
the research tasks make the villager's health bar going down quickly as the building tasks!
The farming tasks never make it going down.
When the health bar is low select Farming or Healing in their details sceen and put your villagers in the pound. Let him doing all they want except researching or building and you'll see their health going up again!!