The Audio Science Review (ASR) approach to reviewing wines.


Imagine doing a wine review as follows - samples of wines are assessed by a reviewer who measures multiple variables including light transmission, specific gravity, residual sugar, salinity, boiling point etc.  These tests are repeated while playing test tones through the samples at different frequencies.

The results are compiled and the winner selected based on those measurements and the reviewer concludes that the other wines can't possibly be as good based on their measured results.  

At no point does the reviewer assess the bouquet of the wine nor taste it.  He relies on the science of measured results and not the decidedly unscientific subjective experience of smell and taste.

That is the ASR approach to audio - drinking Kool Aid, not wine.

toronto416

@analog_aficionado this seems like the most complete explanation of the disparity between certain audiophile communities and ASR.  I'll try to enhance your points without reiterating too much.

Measurements have their place.  The measurements aren't the problem with ASR.  the problem is the mob of people that pounce anyone that says "hey this is better even though it measures poorer"

As if someone could hear the difference between -120 THD and -110.  I agree that at this point, most of these numbers are meaningless as we are well below the 1% THD threshold.  Which is another funny point in all this.  ASR claims to say "you can't tell the difference between amps and cables" based on studies done over 50 years ago, and yet will quibble over -100 Sinad vs -120.  It seems completely absurd to me to both say you're WITH the science, and at the same time be quibbling over measurements that should have NO audible effect based on the "science"

And I have a problem with him listening to the speakers, but not any other equipment because "it all sounds the same" - then what is the point of measuring all of this junk????

After hearing things that they don't measure make a truly substantial differences in my system (Shunyata power conditioning and cabling, proper speaker cabling), I realize that I can only use them for measurements and for feature set breakdowns, NOT for choosing my equipment.

The sad thing is, the "happy panther" scale always rewards the highest measuring equipment because of the horde of stat hunters that are ready to say it's better without hearing any of it.

It's sad really.  These guys are all audio lovers but are sitting there with their $500 topping DACs and amplifiers, running their kefs, with amazon basics wiring thinking they have the best system money can buy.  I used to be angry about it but now I just feel sorry for them.  Sorry that they probably will never experience what a true hi-fi system can do to a person.  Great discussion here, OP

I wouldn't waste any time feeling sorry for them, just like they shouldn't waste any time feeling sorry for you. They're happy with their stuff, you're happy with yours. I'm happy with mine, which probably doesn't meet your standards or theirs. 

 

@analog_aficionado   Thank you for your post.  You have laid out a very logical and concise  reasoning that I have suspected for a long time but never had the technological chops to explain. 

I hope you become a more frequent contributor to this site.

ASR Review:
Over the years, I've read a small handful of ASR speaker reviews.  I've noted the following characteristics:

1. The primary focus of all the reviews were the measurement results
2. In spite of that, the essential imperfection of speakers means that the interpretation of these results is subjective.
3. Any listening impressions were brief and at the end of the review.  
4. All were based on hooking up 1 speaker only. I believe he only listens on-axis.
5. He may (perhaps always) apply EQ to the input signal and A/B the results.
6. The room (and likely, the equipment) used in testing is at his convenience.  For example, large speakers are tested in a sub-optimal room, rather than his listening room.
7. In the few reviews I've read, the listening tests were used to confirm the measurement results.
8.  I've not made an effort to see how non "domes & cones" speakers fare in his testing.

Conclusions:
It does appear that Amir is aware of and somewhat sensitive to the concerns regarding his review methodology.  If you value stereo imaging, his listening tests will probably be singularly unpersuasive.  I haven't (and probably won't) read enough of his speaker reviews to know if his measurement & listening results ever differ.

The testing methodology ASR utilizes is efficient, which enables them to review equipment much more quickly.  However, the knowledge gained is also limited by the process.  The results are thus most useful for the least discriminating.

I cannot understand subjectivist audiophiles or objectivists either...

 

 Acoustics measures by ears and tools matter first and last even over the pieces of gear design because any piece of well done designed gear is replaceable, The room and ears are not.