My experience has been the opposite.
I have always found that less efficient speakers sound more controlled and have the capability to produce a more convincing sense of scale and dynamics. A good sealed box enclosure (infinite baffle) tends to be very inefficient, but if driven with sufficiently high quality power the result can be extremely accurate compared to all but the best ported designs. Many of the high efficiency speakers I have heard sounded relatively out of control to me.
I have always found that less efficient speakers sound more controlled and have the capability to produce a more convincing sense of scale and dynamics. A good sealed box enclosure (infinite baffle) tends to be very inefficient, but if driven with sufficiently high quality power the result can be extremely accurate compared to all but the best ported designs. Many of the high efficiency speakers I have heard sounded relatively out of control to me.