Speaker sharing between Home Theater & Tube amp

I have a two complete separate systems, one for my home theater and another for my vinyl tube system. My home theater has an 11.2 surround setup and my tube system has only the standard 2 channel stereo. Both systems share the same front two speakers.

So far what I have done is manually removed the wires from the home theater system and attached the two wires from the tube amp when I listen to the vinyl using bananas plugs for both.

Has anyone have a simpler way of switching between them?

I tried a standard speaker switch box in reverse, but it's a pain to walk up to the box to switch it and the box has a detrimental effect on the sound for my tube amp so I quit using it. Also if I forget which one it selected, I have to scramble to set it to the correct input.

I know I can't leave both attached because the output transformer from the tube amp will play havoc with the output transistors of the home theater amp and vice-versa.

Anyone has a solution or experience with this dilemma?
.
.
.
.
.
.