You didn't say what tech levels you have, but there are certain prerequisites for fishing. If you grow your population too quickly, food will become a problem unless you have a lot of villagers producing food. Once the children turn 14, you'll be able to train them in research and things should move along better for you.