I know.... it bugs me too.

I have to constantly throw them into the ocean or make them collect coconuts if there was an algae problem in the beginning.

Eventually when the crops are ready to be harvested, the villagers go pick coconuts instead!!!