share 2 CH speakers with HT set up or use separate speakers for front end of a 7.2 HT?

My TV/Listening room currently has 2 separate front ends.
One for music and one for HT/TV.
The 2 channel set up is a Lyngdorf TDAI 2170 into Dali Helicon 800s towers.
The HT set up is Denon X3500 into an AV1213 front end utilizing book shelf speakers for L&R

The room is only 13’ wide and the speakers are kind of close to each other.
I’m wondering if I should ditch the cheaper AV123 book shelf speakers from the HT set up and use some kind of switcher, as long as it doesn’t degrade the signal I get out of my Lyngdorf / Dali 2 CH set up.

I was switching speaker cables for a while (with just one set of speakers for the front end) and I found myself not using my 2 channel set up much because the cable swap was a pain.

I'm sure the Lyngdorf has a HT bypass but my brain is having a hard time figuring out what that actually is, even after reading a few blogs on it,  or if I should be using it. 

What do you folks think?