The crops do come back after a short period of the field going fallow....don't worry too much. There is another backup source of food if you look around as well