Perhaps, but by toeing in the speakers (so they point more directly at the listener) and by placing a diffusing pad on the side wall where the primary reflection would occur you can help reduce the effects of the side walls.
Toeing in will increase brightness slightly ... the only possible downside if your system is already bright.
Toeing in will increase brightness slightly ... the only possible downside if your system is already bright.