Amir and Blind Testing

@noske FWIW, I have a great deal of respect for scientists - I double majored in physics and mathematics.  I have no problem with the tests, but I'm glad you like the pictures!

Rigorous testing is always important in technology, where the goal is the production of identical, interchangeable units.  However, we're so far from "perfect sound" that we're still arguing over which imperfections matter and how much.  The first measurement we targeted was flat frequency response.  Nope, we're not there yet.  So what's worse - a broad suck-out of the midrange, or an extremely high-Q resonance above the range of hearing?  What if the HF causes your amp to oscillate?  What if it's at middle C instead?  Is THD better than IM?  What about TIM?

The answers to these kinds of questions depend on the observer and the other components in the system.  Just curious (I've only looked at a couple ASR reviews), but does he have different acceptability criteria for tube vs solid state?  If he measures speakers, what about planars vs. box speakers?  It's pretty easy to set up your testing standard to fail either group pretty much entirely.

As I said, ASR serves a purpose.  If it works for you, that's great!  Clearly, it's not everyone's cup of tea, though.

I prefer reading Stereophile (I'm guessing that Absolute Sound made this transition also when they hired Robert Harley).  They generally do a subjective test and comparison to reference & similar-priced gear, followed by bench testing that includes listening in an attempt to corroborate both the subjective & objective results.  They always let you know when there are differing opinions on a component.  The bad news is that the industry has gotten too big to cover in that depth, which has resulted in perhaps an undue focus on the most expensive gear.

Is this the same Amir that had his former partner make damning accusations before the thread was removed? The one about bad measurements of competitor products to protect his sponsors?

IMO if you have to do an A/B comparison blindfolded and struggle to hear any major differences, then keep what you Have.  If you don't hear an immediate improvement then cross that item off you list.

Happy Listening.

“Science is a bunch of guys in white coats cutting up frogs”. Woody Allen. But just to drag the thread back on topic, I really wasn’t talking about Amir’s measurements or reviews.  I was talking about his comments on the “analytical brain”  vs the “enjoying music” brain and the difficulty these may cause in evaluating components.  

"Seems to me you need to relax for a few hours at least and listen to a variety of music before your brain can accurately assess whether something is an actual improvement."

It won't matter. If you're expecting a difference you will find that difference. Either in reality or imagination. And if you're really committed to the outcome, you will make an excuse for why you failed to find a difference or identify the correct device.

ABX testing allows you to listen and switch at your own pace with your own music, even over days or months, and still that has made no difference in the outcome of blind tests.

I participated in my first blind amp test in the late 80's and it was an eye-opener. Much along the lines of the infamous 1987 Stereo Review test.