Amir and Blind Testing


Let me start by saying I like watching Amir from ASR, so please let’s not get harsh or the thread will be deleted. Many times, Amir has noted that when we’re inserting a new component in our system, our brains go into (to paraphrase) “analytical mode” and we start hearing imaginary improvements. He has reiterated this many times, saying that when he switched to an expensive cable he heard improvements, but when he switched back to the cheap one, he also heard improvements because the brain switches from “music enjoyment mode” to “analytical mode.” Following this logic, which I agree with, wouldn’t blind testing, or any A/B testing be compromised because our brains are always in analytical mode and therefore feeding us inaccurate data? Seems to me you need to relax for a few hours at least and listen to a variety of music before your brain can accurately assess whether something is an actual improvement.  Perhaps A/B testing is a strawman argument, because the human brain is not a spectrum analyzer.  We are too affected by our biases to come up with any valid data.  Maybe. 

chayro

Prof, with all due respect, Amir's approach still assumes that he is measuring everything that matters in terms of ultimate sound quality. I think that is unlikely to be a valid assumption. If Amir's assumption of perfect measurements is invalid, then the importance of human listening cannot be excluded from any evaluation of a product designed to improve the sound quality of reproduced music. 

Amir talks up the value of unbiased listening tests, but then admits that he is clearly biased and unwilling to go to the trouble of setting up any unbiased listening tests himself. That is the bit that is missing from most of Amir's reviews, including his P12 review. 

 

Amir's approach still assumes that he is measuring everything that matters in terms of ultimate sound quality

I don't see that, he's measuring the DUT and seeing if it does what the manufacturers claim it does. 

Amir talks up the value of unbiased listening tests, but then admits that he is clearly biased and unwilling to go to the trouble of setting up any unbiased listening tests himself.

Why would he set up BDX testing of a component that doesn't do what's claimed? It isn't his place to conduct a DBX but those who claim the component does things the measurements clearly show isn't possible. 

People are missing the point of these reviews. Amir tests the Product, shows the measurements are the same or different from like products or engineering standards . Explains hearing thresholds and says in HIS OPINION there likely is no or little difference in music reproduction and places the product on a scale of similarly measured products. It's not his job to tell you what to buy or if you can hear a difference but if you claim to hear a difference in similarly measured products the only way YOU can rule out YOUR inherent biases is with a properly controlled test. 

A video telling people they are reviewing speakers incorrectly, suggesting the importance of DBT, by a fellow who does sighted listening evaluations against a single DUT while having already seen the data. 
 

Come on. Common sense is failing society. 

Here’s an actual smart person (who designed the powerplant) showing how to measure a power conditioner.