Boy, you've opened a potentially big can-o-worms. I have no idea who is right, but there are those who maintain that it is far easier to damage a speaker with a low powered amp that clips than with a high-powered amp. I believe the theory is that when an amp clips, it outputs something akin to a square wave. A square wave is a sine wave with a series of harmonics. In other words, a clipped wave has more energy in the upper frequencies than the original waveform, and therefore, more energy is sent to the tweeter which burns the tweeter out.
I have no idea if this is true. I don't understand how anyone can run speakers so loud that they can be damaged. Long before damaging levels are reached, the woofer bottoms or the amp clips and makes a horrible sound, and any sane person backs the power down.
As far as sonic concerns (i.e., aside from the damage issue) I am not in the more power is better camp. With tube amps, I don't know of any pentode amps that match the sound quality of triode amps or SETs, assuming the speaker is efficient enough to work with the lower powered amps. With solid state, I like the sound of lower-powered amps, particularly those running hot (generally class A) over a really big amp that is loafing along at a fraction of its output. Solid state amps with huge banks of multiple output devices often sound flat and uninvolving to me. Maybe they really kick ass at high volume, but I never want to go there anyway.