The cause might be if you notice this when you first turn the game on. Sometimes if they are in mid task you will not see the basket they are carrying or rock or anything until the hit one side of their goal, either drop it off, bring it back and start harvesting again. This was a known glitch in beta and what not as well if im not mistaken.