Please explain why this would not work? If you keep the jumper and connect both amps the speaker will sense the signal from either top or bottom binding post. If OP turns off his SS amp, his speaker will only get signal from the amp that is active.
in theory this should work. Unless the extra SS amp connection will interfere with the tube amp