It's not even so much just about solely the sound but overall connecting to and enjoying the music - that is so much of the experience to me. Over the past couple of years I've cobbled together a 2nd system with mainly used gear that I deliberately wanted to sound different than my main system for some variety. It includes a Leben CS-300xs driving a pair of Forte III's, a Node2 running through a Benchmark DAC3, and VN Thorens TD-160 Super (using a Tavish Classic and Rothwell MCX SUT + Hana SL). The entire setup cost me much less than just the DeVore speakers in my main system. I love the 2nd system so much! It is just fun and lets me really jam out and immerse myself in musical joy. It isn't until I immediately A/B the system against my main system do I even realize there is actually a massive sound quality difference between the two.
If I didn't have my main system I'd be happy as a clam just enjoying my 2nd system and not wishing for more sound quality. Music and gear can be really fun without breaking the bank but make no mistake, you can get substantially better sound by spending more. That doesn't necessarily mean you will have more fun with your listening experiences.