"V"...
I think the only thing you can do is try a closer (maybe 1 ft closer) listening position. It may help a bit, probably not much though. If it alleviates some of the problem, I suspect the compromise will be you'll lose some energy.
I'm pretty confident you're dealing with a skewed polar response which isn't too uncommon. Polar response is an amplitude measurement in the vertical plain of the speaker and is related to the transfer function of the crossover, driver placement in the vertical plain and driver offset. Polar response aberrations can be further exasperated by using 1st order networks and having one of the drivers wired internally out of phase.
In light of this, one other thing you might try if you're handy with simple mods is take the driver of the baffle and see if any are wired out of phase. With some of the Klipsch, if I remember correctly, you're likely to find at least one driver connected out of phase. Reverse the leads to correct polarity, put it all back together and give it a listen. Usually, when a driver(s) are wired internally out of phase, it's done to correct another problem such as frequency response so you may find yourself making some trade offs to sound quality.
Kindly,
Robert