You can have as many villagers at the research table as you want. They all just squeeze in there together to get the work done!

The first things you need to focus on in the beginning are a stable food supply and research - especially harvesting, since the berries will be depleted at some point.

Once your food supply is at least 300-400, your villagers will not be as worried and will start doing some of those other things. They'll be more receptive to breeding after that, too!