What about lightning hitting on something currently being constructed (not something already completed), and then they have to start the contruction of the item over again.

Also what about have the villagers getting broken bones and that puts them out of work for a bit (just like when the women have babies, they can't do anything).