Why Don't More People Love Audio?

Tommy, you are not alone. There has been a lot of discussion here about critical listening vs. pure enjoyment of the music (btw, they are not necessarily separable). There's nothing wrong with appreciating the quality of your system and enjoying the music even more because it is well reproduced. Enjoy.

LAck of awareness of audio, confusion, expense, snake oil, easier to stay out alltogether than get caught up in it all.

The number one reason is lack of exposure. Even without all the ear-training, many high end systems are dynamite to listen to at first hearing, musical as can be and fabulous, fabulous imaging. But where in a normal lifetime does a non-cognoscente get to hear such things? Most people have no idea what can be done with sound.

HONESTLY if I knew it was like this, I wouldnt hoop in this hobby either. Too late now, worse than smoking! Nicotine = Soundstage, Tar = Tonal Body, Carbon Monoxide = Money (keep Exhaling ....)

Also convenience. Very few people are willing to put speakers out into the room. Most people don't want tuner / transport / dac / preamp / amp / speaker with all the wires and interconnects as well.
I see posts regularly for people wanting speakers that can be put against the wall. Or for an audiophile grade receiver only to be told it can't be done this way if you want hi-end sound. and it's true - too bad.
So maybe some active Tannoy, Mackie, or ATC monitors and a source with volume control would go a long way in solving the convenience issue while still having good sound.