I would not have ever thought that a single mfg system would be less revealing for the source components. Since I got serious about my system about 6 years ago I have had an all ARC system. I do appreciate major differences with phono cartridges...it is almost as big of a change as speakers. I have a local audio friend with an Auralic streamer that has agreed to bring over to compare. I like buying used gear at a reasonable price and living with it for a while and then selling if not impressed. I need to get more familiar with what else is out there in the streamer world and try another. It's fun and maddening at times...but mostly fun :)
To your strategy of abandoning the house sound of certain mfg, I cannot fathom the idea of starting over with everything. Overall I love the sound my system generates but am always looking for that bump upward