It is a function of your income / value of sound quality.
I am retired. Right now my sweet spot is $35K for speakers and ~ $20K per component… about 8 of them. If my investment portfolio were to double I would double the investment in my speakers (to Sonus Faber Lillium) and preamp (Audio Research Reference 10)… maybe my amp (Audio Research 160m to Reference 320s)…
So, I guess for me it is generally financial. My system cost many times the value of my Lexus and 4Runner… audio, far more important than automobiles.