Why Do So Many Audiophiles Reject Blind Testing Of Audio Components?


Because it was scientifically proven to be useless more than 60 years ago.

A speech scientist by the name of Irwin Pollack have conducted an experiment in the early 1950s. In a blind ABX listening test, he asked people to distinguish minimal pairs of consonants (like “r” and “l”, or “t” and “p”).

He found out that listeners had no problem telling these consonants apart when they were played back immediately one after the other. But as he increased the pause between the playbacks, the listener’s ability to distinguish between them diminished. Once the time separating the sounds exceeded 10-15 milliseconds (approximately 1/100th of a second), people had a really hard time telling obviously different sounds apart. Their answers became statistically no better than a random guess.

If you are interested in the science of these things, here’s a nice summary:

Categorical and noncategorical modes of speech perception along the voicing continuum

Since then, the experiment was repeated many times (last major update in 2000, Reliability of a dichotic consonant-vowel pairs task using an ABX procedure.)

So reliably recognizing the difference between similar sounds in an ABX environment is impossible. 15ms playback gap, and the listener’s guess becomes no better than random. This happens because humans don't have any meaningful waveform memory. We cannot exactly recall the sound itself, and rely on various mental models for comparison. It takes time and effort to develop these models, thus making us really bad at playing "spot the sonic difference right now and here" game.

Also, please note that the experimenters were using the sounds of speech. Human ears have significantly better resolution and discrimination in the speech spectrum. If a comparison method is not working well with speech, it would not work at all with music.

So the “double blind testing” crowd is worshiping an ABX protocol that was scientifically proven more than 60 years ago to be completely unsuitable for telling similar sounds apart. And they insist all the other methods are “unscientific.”

The irony seems to be lost on them.

Why do so many audiophiles reject blind testing of audio components? - Quora
128x128artemus_5
You have to admit, in audio blind testing is way more effective than deaf testing...just sayin’...
You are not completely right here.... 😊

Conforming their hearing to their tools and conditioning their own ears by designing habits to obey the measuring gear tools is worst than being deaf, because "deaf testing" could be right by the law of chance more often then listening systematically only the end results of pure design numbers with no real supervision by "non professional ears"...

Happily, like i said most engineers are also artists hearing really for the music and not only to the "corrected" sound, wearing very precise clothing in imperial habits and measures....Pass labs designer for example, or the crowds of Sansui Engineers and many others one look for a sound quality very audible and not explainable by the numbers only...They had discovered the right measuring numbers to fit them, they dont conform their creativity and ears to numbers...



«Numbers contains reality they are not reality»-Anonymus Smith

«Numbers obey something else and we must called it love»-Anonymus Smith

«Like love encompassing everything, prime numbers distribution contains everything and no one knows why and even how it is possible»-Anonymus Smith

«Prime numbers are the deepest mystery completely wrapped in the more simplest way and plain for all to see»-Anonymus Smith

«Prime numbers distribution is so powerful that it give sleepness night to all mathematicians from the beginning of time.»-Anonymus Smith

«You think too much, f... yourself less and f... some others more»-Groucho Marx 🤓
five pages of meandering posts

in my view, the simple and honest answer to the op’s titled question is

1, it takes alot of effort (and involvement of more than one person) to run a proper blind test

2. many don’t want to know the real answers that such a test would likely reveal, or would reject them with some baseless rationale anyway

subjective, passion-driven undertakings are usually not prone to intellectual honesty - takes the fun out of the proceedings and the romantic sensibilities that go with it
As jakleiss (who does real testing) has already pointed out:
Excuse me, I meant to write above "..blind testing is NOT a test methodology..."

All the best,
Nonoise
Passion driven undertakings are no more or less prone to real answers than purely intellectual undertakings. You are making a meaningless comparison because no "best" exists when it comes to most of the pursuits driven by our senses. There are no real answers, just opinions as there is no standard of correct/real. Further, measurements get you part of the way, but certain devices have attributes that cant be measured but sound better in many instances. Vacuum tubes would be a perfect example or tube amps if you like. Take it one step further and determine if it actually is some of the things that make it measure poorly that actually make it sound better.

audition__audio
798 posts
05-05-2021 10:20am
Passion driven undertakings are no more or less prone to real answers than purely intellectual undertakings. You are making a meaningless comparison because no "best" exists when it comes to most of the pursuits driven by our senses. There are no real answers, just opinions as there is no standard of correct/real. Further, measurements get you part of the way, but certain devices have attributes that cant be measured but sound better in many instances. Vacuum tubes would be a perfect example or tube amps if you like. Take it one step further and determine if it actually is some of the things that make it measure poorly that actually make it sound better.
There is a reason vacuum tubes sound better in many instances. One has to do with superior linearity in a well designed hifi amp/preamp. Same could be said for powering subwoofers with a solid state amp of good design.

So....you being the arbiter of "meaningless comparisons" is simply absurd.

Guidelines in engineering standards by an organization like AES means that a manufacturer just can't make up stuff that can't be proven through tests.