There are "enthusiasts" in every area of human activity; why should music and it’s reproduction be an exception? I find the lack of a deep interest in music of more concern than that of hi-fi. Most of the musicians I know listen to music on their computer’s speakers; Evan Johns’ system was a boom box!
The average person (what an insulting thing to call anyone ;-) does not sit and listen to music as a "destination" activity, the focus of one’s consciousness. It is THAT fact, not that HEA audio components have become too high in mass (what an odd contention; my EAR-Yoshino 868L provides better sound than did my ARC L16, and weighs about twice as much. Same with my Herron VTPH-1 vs. my ARC PH3.), that is largely responsible for the decline in sales of high performance music systems.