Yeah, that happened to me, too. Part of my strategy to keep the food supply fresh was not to start having babies until my village could sustain itself. So for a while I couldn't collect items. Then once I had my food under control, the villagers went on to baby booms.