See Do you ring the gong every day?
I was worried at first, but I put all my villagers on Farming and got it back rather quickly.