The food level drops because the villagers eat, even though there are only 12 villagers

Also, farmers may prefer to pick fruit than go fishing. I have no idea why the fruit isn't making a difference. Are you sure that you have gotten the sharks away so you can go fishing? If so, what version of VV3 are you currently running?