The game speed affects far more than how fast villagers age. One of those areas is villager productivity (since in VV2 there is now an adjustment for game speed, which wasn't there in VV1). To see a more complete answer, look here.