Uncledemp- your post fascinated me, and after giving it some thought, my response would be something like:
scientific or engineering training or any form of higher education for that matter, teaches methodology- how to approach an issue and ask the right questions, rather than knowing the answers;
a lot of audio equipment is following tried and true science or engineering principles with variations and modest "improvements" that may or may not prove to be enduring or universally satisfying;
innovation can come from anywhere- conception and development doesn't necessarily require massive expenditure or white lab coats- but the adoption of new formats requires industry consensus and re-tooling or broader manufacture that does involve clout and buy-in; many of these were utter failures in the marketplace;
Why the divergence between pure science and engineering on the one hand, and the subjective audio experience on the other? It seems to me that we are, all of us, trying to recreate a sensory experience. The engineering and sciences involved are multi-disciplinary: electrical engineering, mechanical engineering and materials science, acoustics and psycho-acoustics, etc. But at the end, there is still a human, making design choices and a human making listening evaluations.
There are people that say that two channel audio can never recreate the illusion of a musical performance, but that, and some forms of multi-channel sound, seem to be all we have to work with right now. I've always been intrigued by the history of ideas and invention; thus, my peculiar take on your post. Others may have a different view, but in my experience, I have heard very convincing sonic illusions created by the most mundane or antiquated gear or formats, and completely unconvincing (though sometimes impressive) sounds created by the most expensive, elaborate audio systems. I'm discounting source, room and placement, and dialing in or set up as well as the purely subjective aspects of listener preference. Not sure I "answered" your question, but perhaps gave the "why" some context.