The maid and gardener only stay for a while, then they disappear again through the portal between the gate and front door that they use when they arrive. They don't seem to work all that late in the evening so there's not really much point to another button, IMO.