Bryston makes a well-respected switch box for those purposes. It has three outputs for three sets of speakers (a single input, or course). I recall reading of a reviewer using one of these units to compare speakers claiming that it did not introduce an audible coloration to their ears.
Marco
Marco