You don't need to feed the villagers they do that on their own, young and old alike.

Until your villagers are able to fish on their own, I'd for sure pause the game, even if you're gone for a short while.

LadyCFII's Sticky Note is a must read for anyone just starting out! Have fun and good luck playing VV3.