That will happen in several other places as well. Always during the startup, or when the temple is completed. The program randomly selects where to put villagers, and I guess it thinks that would be a good place. I like to refer to it as jail.