Good old days

Seems to me that the problem is not your system; especially if, as you say, you “like it too much”.  By starting to change out gear in order to find the new “right” gear you will just be feeding the monster.  If you like your current system so much it is unlikely that you will be happy with equipment that sounds less good.  The issue is your mindset.  A lot of my listening is outside the “sweet spot”.  Try, as I do, listening off axis.  Put your comfy listening chair somewhere in the room where you are not forced to look at all those audio toys, the sight of which triggers the audiophile itch.  Get out of electronic land.  See what happens.  

Tylermunns,

You are so right. …the beauty, wonder, and splendor of music” is the thing.  The love of Hifi  pales in comparison. 

My bet is that you don't love your system. 

I remember doing the same thing—always listening for the good bits and always aware of the bad bits in the reproduction chain. 

Eventually, over many tweaks, things clicked. Now I have no issues listening and everything sounds wonderful. Something is amiss and you need to locate it. 

Frogman,

Good suggestion.

When I listen in my car, or through earbuds when traveling, music can also be very enjoyable.  It is definitely more enjoyable when I get home and plop down in front of my hifi though.  It seems like its not really important to choose between the two, we can jiust enjoy what we are doing at the time.