Haven't had the luxury of downgrading since re-entering the world of hi-fi ten years ago. Still tweaking up, but on a tightwad's budget.
That said, I agree with Schubert's comment about the effect of the room. My "best" speakers did not sound so great in my teaching/practice studio at our new place so I moved them into a "living" area. Wow--night and day! I now put "the room" on a par with the speakers as far as overall importance.