My personal experience, jumping back to 1994:
Purchased MTM set of parts mid, tweeter, mid from Dynaudio.
Purchased 12" woofers from Focal. (these 2 companies no longer sell to hobbyists but a lot of other great companies still do)
Purchased crossover parts from Madisound. I thought i was pretty clever - i designed the crossover myself using formulas out of books possible from Vance Dickason if my memory serves. Madisound ran my design through their LEAP computer program and made some suggestions to make my design better, so i followed their advice. I built the cabinets myself. They were a bit goofy looking, but had all kinds of features that i learned from Speaker Builder Magazine, and from Madisound forum. They did the job!
SO, in conclusion, the stereo imaging was not perfect - i mean, they are large, and the crossover was built by a rookie, but everything else was, and still is, out of this world! sound quality over the complete range, power, clarity, Huge bass but only when called for in the music, amazing vocals, mids, highs, no weakness.
So it can be done, and if you go with a proven designer you will be even better off than i am!!