It depends entirely upon how much food you have available to sustain them until they're 14 years old and can begin gathering food for themselves. At normal game speed, a 2-year-old will turn 14 in about 24 hours. If all of your toddlers are 2 (which would be the worst-case scenario), you'd need at least 1000 food in the bin to keep them from starving to death. If you have significantly more than that, they probably won't even lose health before they turn 14. If you have less than 1000, it will be dicey.