Instead of waiting for them to walk all the way across the universe when they're doing their building, if you interrupt them part-way & cause them to drop what they had (assuming they're removing & not building) does it still work?