Looks like your villagers were bored and "found something" to do!

The villagers will do things that you didn't tell them to do regardless of what skill you have checked. They just "tend" to stick with the skill that is checked!