...my statement refers to aiming for a perfectly flat measured speaker response as a sonic end point
But the thread is about the time domain performance of a speaker.
One cannot change that too much with DSP. The impulse response can be cleaned up somewhat. But in the edges of the crossover bands it is not really possible to do much in a passive system compared to an active one.
Once the non-time/phase aligned system and the time/phase align systems are in place, then either/both can have the frequency response dialed into what ever is asked for.
And the question then that the OP sort of asked is, "will they sound different?"