The slowness of the game may be to do with the amount of villagers. I have only noticed slugishness with the screen refreshing after I have over 50 villagers.

Are you up to this sort of number yet? (sorry don't know which anonymous you are still!!)