You hit on exactly the issues at play. First of all "feeling" is very much a part of the way a system sounds. You not only hear music, but you also feel it. Second of all is experience. You do not know what you are missing, what is possible, until you experience it. I was lucky in that I worked my way through graduate school working in the high end HiFi business. Of all the systems I have heard over the years only three could fool me into thinking a voice was in the room with me, that eyes close I could be at a live performance, three systems out of hundreds. Most people have never heard a system do this magic act. That is not to say they have never heard an impressive system, a system that impresses immediately is more likely to be hopelessly colored.
How does having a system that performs at this level "feel"? No different. I built my first system from Dynakits when I was 13 and an evolving process has taken place since then. I did not experience reference system #1 until I was 23. I have been doing touch up for the last 20 years or so, conquering minor errors or weaknesses. I have three more changes/additions to make and I will be 99.9% at target. Anything I do after that will be frill unless there is some major new technology
One more thing I would like to point out is Audiophiles can be hopelessly traditional.They tend to avoid new technologies that can make significant improvements in system performance like digital signal processing. Most excellent systems will never achieve greatness without it. I was at a friends house last weekend. I came with my laptop and microphone to measure his system. The character of the sound accepting the bass was excellent. The bass and imaging sucked and this was a $125,000 system. The subwoofers were not set up correctly (easy to fix), but more importantly the right speaker was down 10 dB at 300 Hz. This is due to the room not the speaker and this is what is screwing up the image. You can mess around with acoustic treatments until the cows come home and you are not going to get these speakers within 1 dB of each other without turning the room into an anechoic chamber. Digital EQ is the only way you are going to conquer this. Next time I go over I am going to bring a digital preamp to show him what happens when you make these adjustments. I find it interesting that very few "audiophiles" have ever measured their system. They want to do it by ear. Right.