Raven, I think you should be fine then, just keep an eye on those villagers, and make sure they keep doing the jobs that you want them to do