Maybe that one tree has the villager's favorite fruit!
Seriously though, it's most likely that your farmers are picking fruit off that tree before it registers. As well as clicking on the tree often like Laurence suggested to see what it says, also keep an eye on your food bin. You may see the difference there.

Marcey