The Audio Science Review (ASR) approach to reviewing wines.


Imagine doing a wine review as follows - samples of wines are assessed by a reviewer who measures multiple variables including light transmission, specific gravity, residual sugar, salinity, boiling point etc.  These tests are repeated while playing test tones through the samples at different frequencies.

The results are compiled and the winner selected based on those measurements and the reviewer concludes that the other wines can't possibly be as good based on their measured results.  

At no point does the reviewer assess the bouquet of the wine nor taste it.  He relies on the science of measured results and not the decidedly unscientific subjective experience of smell and taste.

That is the ASR approach to audio - drinking Kool Aid, not wine.

toronto416

The folks on this site seems to give too much importance to ASR. Time to move on.

@prof 

Sorry, not calling you out on this, but you said "ASR evaluates equipment based on objective criteria that has been found to predict certain aspects of sound quality".

I was hoping that you could point to a link/post/discussion on ASR covering how the reader would correlate measurement anomalies directly with SQ issues?  This is 1 of the 2 big holes I find in reading ASR reviews, so hopefully it's covered somewhere on the site, in depth.

For example, in a Stereophile-style review, the listener might say something like "trumpet was a little spitty in its high register".  In the measurements section, that might be correlated with a slight rise in the on- or off-axis response.  In ASR, the measurements go first, so you get the same data.  In the listening section, though, you might see that Amir tried EQ'ing out the slight rise and liked or didn't care for the result.  No indication of how the listener would perceive the original issue.

The other big hole is imaging, which is ignored in the monaural listening test.  This has 2 parts - the first, alluded to above - due to the loss of the stereo image with only 1 speaker in play.  

There's also the speaker design - box vs planars vs horns vs OB, etc.  Each of these have significantly different radiating patterns.  Their optimum measurement results should also be radically different.

How is any of this information being conveyed to the reader?

 

@hilde45 

I had a long and bitter debate with Ethan Winer about this. My position is that there may be things heard which cannot be measured because the brain and perception are way WAY beyond our understanding at this point in our scientific understanding. His reply to that was, essentially, "No, it’s just placebo effect and subjective bias." (In other words, y’all are just in denial.)

I recall there was a really enjoyable exchange between Jay Luong of Audio Bacon and Ethan Winer in the comments on one of his reviews; probably the power cable one. 

Summary off the top of my head is: Ethan said what you stated above, Jay imagined all of it, no proof etc. and also Jay had no scientific background. Jay responded he was an electrical engineer, Ethan said he must not be a very good one if he believed there were differences in power cables, Jay said he received a Bill Gates scholarship, so yeah he probably was a pretty good electrical engineer. Ethan did not have much to say after that. Quite comical. 

@jrareform 

The measurements aren't the problem with ASR.  the problem is the mob of people that pounce anyone that says "hey this is better even though it measures poorer"

Exactly.