Fascinating comments above. I guess another huge obstacle is all the Cable connections would have to be increased coming out of the back of the components if you expand from two channel listening to more channels. Vastly complicating the cabling and connectivity issues of the components.
If you have a good speaker system and great amplification, I guess the benefits are marginal. But there did seem to be openness in comments that there is potential it could be actually better.
Because I have nice speakers and amplification, including lots of tubes, I tend to listen to my home theater with two main speakers, eliminate the center channel and leave in the surround rear speakers . Often times this is a lot better. But other times you need the center speaker so the dialogue is more discernible and doesn't disrupt what's going on in the main speakers. This configuration can be handled toggling back-and-forth between two settings settings on the home theater remote. Ie. Super easy to go back-and-forth.
So at least on the home theater side I have the flexibility and it is working out really well