Slow it down to half speed when you arent around, and maybe make sure your little dudes know how to forrage / take care of a crop...

they shouldnt die of starvation while you are not watching them then...