I have deliberately downgraded my system, and it wasn't long before I found myself not listening to music as much as I used to; not happy with SQ and lack of PRaT. I now have the same brand of integrated amp and speakers as I did before the downgrade, although different models. My power conditioner and half my cables are also the same brand as before.
If you can downgrade (but not too low) and find a balance that suits you, perhaps it would work for you if you were able to keep some of the sonic virtues that you currently enjoy. But you will hear the difference; whether you care for it is something I can't answer.
If you decide to try it, I recommend not parting with your current system until you know the outcome of the downgrade; unless you're comfortable with putting a good system back together, and the selling/buying involved with it.