the reason phase coherent speakers aren't the order of the day is because the virtues of that strategem haven't acquitted themselves as highly important. Typically speakers that make that a cheif priority make detrimental compromises in some other facet.
IMO, given that a HiFi should come as close as possible to recreating the original performance, be it a well recorded orchestra in a great hall or a pop effects menagerie, unless the phase is correct, that is not possible.
Many recordings have zero phase information from over miking and effects. Some early stereo recordings are magical when heard on correctly phased system achieving an 'aliveness' otherwise not possible.
If accurate sound stage presentation and performer focus is a priority, good phase performance is mandatory.
Again, IMO, the reason phase is not pursued is it is difficult, and therefore expensive, and there is no point when most consumers are oblivious.