Good read: why comparing specifications is pointless

I think Alpha Audio inadvertently made the opposite case. You need to have independent third-party testing to make sure the product you're buying at least matches manufacturer's published specifications. If the manufacturer provides none, then it should be tested and measured to ensure it's at least designed properly and functions as expected.

The measurements performed at ASR, Erin's Audio Corner, Stereophile, and SoundStage Hi-Fi (to name a few) typically use a consistent method for obtaining those numbers. In that case, you can compare the performance using those measurements because you know the measurement parameters.

He is saying simple "spec numbers" are no good and he is right.  You want to see full measurement graphs so that you can see the tested parameter varied.  Of course this is what I do at ASR day in and day out.  Here is the power measurements of an amp:

Note how I provide references of a mediocre and stated of the art amp at the same time to give you context.  Without it, you can get lost in see of numbers he is showing you.  

He then makes a bunch of other comments about power mattering at micro-watts which is neither here, nor there.  First, he calls them "distortion" when in reality that part of the graph (sloping down) is completely dominated by noise.  Distortion only takes over when the graph starts to move up which only happens near clipping (exception are amps without feedback or distortion-factory ones).

I also don't believe in this "first watt" business.  Speakers have become smaller to fit in homes better over the years and this has made them much less sensitive.  As a result, 1 watt is not going to do anything for you.  For this reason, I have standardized on 5 watts as a low value power output:

Notice the comprehensive dashboard that not only gives you distortion, but also the amplifier gain and full spectrum of noise+distortion.  The latter lets you apply perceptual analysis to determine audibility.  

Bottom line, yes, run fast from any single value specs thrown out there without detailed data as I have presented.  As a practical matter, for non-speaker products, you do need to stick to one source of measurements.  In my case, I have tested over 1000 audio products of this class in the last few years.  So you can compare with confidence.

For speakers (and headphones to some extent) we have quality measurement standard in the form of ANSI/CEA-2034.  With this data, you can indeed compare one source to another. This is what it looks like:

In on graph you get on-axis and (important) off-axis response.  And directivity.

You don't get distortion so I have added that with two (and sometimes three) standardized levels:

I have over 200 speakers measurements (I think) and others have posted measurements using similar scheme.  That hole then is being filled nicely although the process remains more expensive than for electronics.

Specs, in order of importance IMO:

1) in room FR

2) in room FR

3) in room FR

Unless you get that one the way you want I would agree, the rest of the specs are pointless.

You have to know what you are doing with in-room frequency response.  Otherwise, you have more than useless information.  Dr. Toole says it best in his wonderful book: Sound Reproduction: The Acoustics and Psychoacoustics of Loudspeakers and Rooms

Mind you, you absolutely need to measure your room and correct (the right) frequency response errors.  Just don't chase measurements without fully understanding how our perception works and difference between one microphone and two ears.  The internet is replete with wrong measurements and approaches to rooms.