Hi OP,
I have been retired for five years. Before retirement, I went through the same kind of thinking. I upgraded so I would no longer have to make any more purchases. After retirement for a couple years I realized I could afford another upgrade and did. You can see my systems under my userID.
I am fortunate to have both a very good headphone system and main system. I use them both. I listen to my main system about three hours a day and my headphone system about half the time for an hour a day. But unless you are really unusual, having just a headphone system will not fulfilling and comfortable as a main system. Obviously both would be preferred. Assembling an ideal system is about equally difficult for headphone or main system.
As far as the sound quality… I completely understand. Happily my system has the kind of detail, midrange bloom, and rhythm and pace you describe. A system that sucks you in through the upright bass line or the vibrations of low notes from a sax.
I think it would be really helpful to start by hearing the sound you are after. I recommend going and listening to an Audio Research I-50 with some good quality speakers. I remember the first time I heard this unit 6 years ago (?)… I was just shocked how warm and wonderful it sounded. I realize because of the really low sensitivity of your speakers this unit will not drive your speakers. But the purpose is to answer the question is this what you are going for. If this has got the stuff, then you want to be looking at used ARC, Conrad Johnson, Cary, or VAC. Rogue uses tubes, but does not get the sound these other companies do.
Some of this tube stuff would pair well with Quads.. which would really send your system towards where you want it to be.