I am generally in agreement with the line of reasoning advanced by threeeasypayments. But you need to decide what you are trying to accomplish.
Are you trying to make a change that will give you an incremental improvement in sound quality? Or are you ultimately wanting to achieve a top tier listening experience?
If it is the former, then replacing the weakest link, if you can determine with certainty what that is, can accomplish that. If you go that way, don't buy anything your can't resell or return with minimal loss. If the later, then the following comment needs to be the foundation of your thinking.
I believe the whole point is to optimize the synergy among your components & room to best connect you to the music and stir your soul.
If you want to get from good to great, it is a long hard road, but that road has to start with selecting a high quality speaker that is capable of functioning well in your room and setting up that speaker in the room to minimize contribution of the room's acoustical properties to what you hear at your main listening position. If you don't get that right, nothing else you do is going to make a huge difference, and you will never get from good to great. Believe me, I know. I spent decades chasing better sound through random equipment swaps.
Four years ago I had a room full of great gear (and it wasn't cheap, by the way) that sounded like crap. Now, having changed only one component, I've got outstanding performance. Better than half of the improvement was due to optimizing speaker and listening position, utilizing standard room treatments to address low frequency ringing, and addressing floor vibration and isolating equipment from the floor. All of that work, with the exception of dealing with the floor, was relatively inexpensive. It's value proposition was off the charts.
Good luck!
