Sounds like you are still quite early in the game -- you need a specific level of tech to fish. Otherwise your villagers will simply swim and not look for fish.

You also have to make sure they have a clean place to fish from.

Check out the strategy guides here for more info, or search the forums for some of other topics on fishing.