Yes, I managed to lose all of mine. I think it had to do with pausing the game for awhile while the ball was laying around the house (maybe not pausing the game and just leaving the ball laying around, I don't really remember it's been so long). When I went to pick it up, it disappeared.