Unsound, I think the 'harm' comes in when the speaker requires that the amp use a lot of feedback to work right with the speaker. Since our ears use the 5th, 7th and 9th harmonics as a means to perceive sound pressure, and since negative feedback is known to audibly enhance (distort) these harmonics, the result is something that sounds more like electronics and less like music.
This harmonic distortion contributes to the amp sounding 'loud' or 'shouty', even though it might be nowhere near clipping. Now we get back on-topic: tubes, which generally use less feedback, tend to have more *usable* power as they tend to sound less 'shouty', and thus encourage you to turn the volume control up higher without stress. This assumes, of course, that the tube amp is able to drive the same speaker that the transistor amp can, for any kind of reasonable comparison.
IME if the speaker is has reasonable efficiency, and lacks weird phase angles and the like (IOW is not demanding of the amplifier), that **all** amps driving that speaker will sound better. BTW this is a strong argument for higher impedances, since even though a transistor amp might be able to drive a 3 or 4 ohm load without strain, that is not the same thing as saying it is sounding its best while doing so.
This harmonic distortion contributes to the amp sounding 'loud' or 'shouty', even though it might be nowhere near clipping. Now we get back on-topic: tubes, which generally use less feedback, tend to have more *usable* power as they tend to sound less 'shouty', and thus encourage you to turn the volume control up higher without stress. This assumes, of course, that the tube amp is able to drive the same speaker that the transistor amp can, for any kind of reasonable comparison.
IME if the speaker is has reasonable efficiency, and lacks weird phase angles and the like (IOW is not demanding of the amplifier), that **all** amps driving that speaker will sound better. BTW this is a strong argument for higher impedances, since even though a transistor amp might be able to drive a 3 or 4 ohm load without strain, that is not the same thing as saying it is sounding its best while doing so.