I think it is a matter of finding the right speaker and then matching them with the proper amplification. Even if the the speakers are supposedly not efficient enough to work well with lower-powered amps, I personally find that, in most instances they can be made to work with modestly powered tube amps. I find that most people grossly over estimate the amount of power they need or try to achieve rock concert volume level even though the speakers and the room itself are ill-equipped for such practices. Every choice is a set of compromises and I personally choose to go with very high quality at modest listening levels, and every improvement I make tends to make the sound enjoyable at lower, not higher, volume levels.
If you like the Harbeth speakers you have, I don't see how you can save money by getting another speaker of higher efficiency and then looking for a lower powered amp. The really good sounding low powered amps are NOT cheaper just because they deliver lower power. High power these days is cheap to achieve, quality at all levels of power is not.
My local Harbeth dealer sells only tube amplifiers, and most of them, including the best sounding ones, are low powered. The only Harbeth model that seems to benefit from higher power is the 40.2, and even they sounded their best with particularly good lower-powered amps (but played at decent, but not extremely loud levels).