You should either seperate your group, half the people on the rubble and the other the hut. Or, maybe you should work on one at a time.