We've had reports of lost villagers even after the carving is completed, so I'm not sure that it's related to the stage of construction. The boulder might also be a 'bad place' - villagers have been lost there, too.