Good read: why comparing specifications is pointless


 

“ … Bitrates, sampling rates, bit sizes, wattages, amplifier classes…. as an audio enthusiast, there are countless specifications to compare. But it is – virtually – all meaningless. Why? Because the specifications that matter are not reported ánd because every manufacturer measures differently. let’s explain that...”

 

 

128x128akg_ca

He is saying simple "spec numbers" are no good and he is right.  You want to see full measurement graphs so that you can see the tested parameter varied.  Of course this is what I do at ASR day in and day out.  Here is the power measurements of an amp:

 

Note how I provide references of a mediocre and stated of the art amp at the same time to give you context.  Without it, you can get lost in see of numbers he is showing you.  

He then makes a bunch of other comments about power mattering at micro-watts which is neither here, nor there.  First, he calls them "distortion" when in reality that part of the graph (sloping down) is completely dominated by noise.  Distortion only takes over when the graph starts to move up which only happens near clipping (exception are amps without feedback or distortion-factory ones).

I also don't believe in this "first watt" business.  Speakers have become smaller to fit in homes better over the years and this has made them much less sensitive.  As a result, 1 watt is not going to do anything for you.  For this reason, I have standardized on 5 watts as a low value power output:

 

Notice the comprehensive dashboard that not only gives you distortion, but also the amplifier gain and full spectrum of noise+distortion.  The latter lets you apply perceptual analysis to determine audibility.  

Bottom line, yes, run fast from any single value specs thrown out there without detailed data as I have presented.  As a practical matter, for non-speaker products, you do need to stick to one source of measurements.  In my case, I have tested over 1000 audio products of this class in the last few years.  So you can compare with confidence.

For speakers (and headphones to some extent) we have quality measurement standard in the form of ANSI/CEA-2034.  With this data, you can indeed compare one source to another. This is what it looks like:

 

In on graph you get on-axis and (important) off-axis response.  And directivity.

You don't get distortion so I have added that with two (and sometimes three) standardized levels:

 

I have over 200 speakers measurements (I think) and others have posted measurements using similar scheme.  That hole then is being filled nicely although the process remains more expensive than for electronics.

Specs, in order of importance IMO:

1) in room FR

2) in room FR

3) in room FR

Unless you get that one the way you want I would agree, the rest of the specs are pointless.

You have to know what you are doing with in-room frequency response.  Otherwise, you have more than useless information.  Dr. Toole says it best in his wonderful book: Sound Reproduction: The Acoustics and Psychoacoustics of Loudspeakers and Rooms

 

Mind you, you absolutely need to measure your room and correct (the right) frequency response errors.  Just don't chase measurements without fully understanding how our perception works and difference between one microphone and two ears.  The internet is replete with wrong measurements and approaches to rooms.

Unless you get that one the way you want I would agree, the rest of the specs are pointless.

Who are you agreeing with, yourself?  Only in audio some folks think knowing less about what they are buying is a benefit to them.  Get the manufacturers to back their fidelity claims.  

That aside, OP said nothing about specs not being useful.  Measurements tell you if devices do nothing for your sound.  How much noise an amp can generate.  How much power it has, etc.  If you don't know this then you have a lot of learning to do.  

I am agreeing with "Good read: Why comparing specifications is pointless"

You take Revel or some other good measuring speaker, put it in a room with hard flat surfaces and you don’t need a FR chart to know that it ain’t singing like it could.

What is the point of having a golf swing panther DAC in a headless panther room? You tell me...