Amir and Blind Testing


Let me start by saying I like watching Amir from ASR, so please let’s not get harsh or the thread will be deleted. Many times, Amir has noted that when we’re inserting a new component in our system, our brains go into (to paraphrase) “analytical mode” and we start hearing imaginary improvements. He has reiterated this many times, saying that when he switched to an expensive cable he heard improvements, but when he switched back to the cheap one, he also heard improvements because the brain switches from “music enjoyment mode” to “analytical mode.” Following this logic, which I agree with, wouldn’t blind testing, or any A/B testing be compromised because our brains are always in analytical mode and therefore feeding us inaccurate data? Seems to me you need to relax for a few hours at least and listen to a variety of music before your brain can accurately assess whether something is an actual improvement.  Perhaps A/B testing is a strawman argument, because the human brain is not a spectrum analyzer.  We are too affected by our biases to come up with any valid data.  Maybe. 

chayro

@mijostyn The result of all this is an entire industry based on deception. As long as it is not my money why should I care? 

Two ideas there - of course it is none of anyone's business about the spending proclivities of people outside of your personal circle.

However, due to the absence of prudent market regulation, an industry built on deception is far from optimal.  Due reward and incentives are not forthcoming to those with novel and robust products and who by definition do not partake of the deception cup.  Innovation in these pursuits is relatively stifled.

That's why I care.

@daveinpa  I like your post! Your category 3 is right on. It is fine to buy something just because it makes you feel better. What seems to generate the most angst in these discussions is when people buy things for Reason 3, while trying to convince themselves it is for Reason 1.  Then they go seeking confirmation from others on an audio forum.  If there are no measurements or the measurements tell a story they don't want to hear then they become anti measurement and seek confirmation in the opinions of others who agree with them. Wait a second, this isn't gong on just in audio, it's all over the place!

Anyway, nice analysis Dave!

Thanks!

After i got a new pre-amp and had the revelation of category #1 (irrefutable improvement) i've been on a quest to get that again. Last night i unpacked by new Pontus II DAC that replaced the Bluesound Node 2i internal DAC and got that "without a doubt it sounds better" result. I'm just afraid as i continue to spend more money and replace more components i'm getting into the 0%-10% categories and won't have that leap forward sound improvement I've gotten with my initial component upgrades. Moving to mono block tube amps next!

 

And FWIW - i like Amir's contributions and content in general. For things like cables and power conditioners showing there is zero difference to me is pretty hard data to argue against. However, when it comes to DACs, amps, etc. i think its a different ball game as to what to measure. Sure you can have great measurements but that doesn't mean it sounds great. And i'm sure you can have crappy measurements and it does sound great. But its nice to see good measurements for something you've spent a lot on.

@larsman's

 

You tube is rather different to the current big Audio Reviewing industry. Anyone can go on Youtube and say what they want, i see that as a good thing thou. Its the industry I'm talking about the paid Advertisement reviews.