Hang in there! The crops will grow... and then you should have plenty of food for your 5 villagers. Sometimes it gets pretty scary with the food situation, but I've found my village usually recovers from a close call like this.