Why Do So Many Audiophiles Reject Blind Testing Of Audio Components?


Because it was scientifically proven to be useless more than 60 years ago.

A speech scientist by the name of Irwin Pollack have conducted an experiment in the early 1950s. In a blind ABX listening test, he asked people to distinguish minimal pairs of consonants (like “r” and “l”, or “t” and “p”).

He found out that listeners had no problem telling these consonants apart when they were played back immediately one after the other. But as he increased the pause between the playbacks, the listener’s ability to distinguish between them diminished. Once the time separating the sounds exceeded 10-15 milliseconds (approximately 1/100th of a second), people had a really hard time telling obviously different sounds apart. Their answers became statistically no better than a random guess.

If you are interested in the science of these things, here’s a nice summary:

Categorical and noncategorical modes of speech perception along the voicing continuum

Since then, the experiment was repeated many times (last major update in 2000, Reliability of a dichotic consonant-vowel pairs task using an ABX procedure.)

So reliably recognizing the difference between similar sounds in an ABX environment is impossible. 15ms playback gap, and the listener’s guess becomes no better than random. This happens because humans don't have any meaningful waveform memory. We cannot exactly recall the sound itself, and rely on various mental models for comparison. It takes time and effort to develop these models, thus making us really bad at playing "spot the sonic difference right now and here" game.

Also, please note that the experimenters were using the sounds of speech. Human ears have significantly better resolution and discrimination in the speech spectrum. If a comparison method is not working well with speech, it would not work at all with music.

So the “double blind testing” crowd is worshiping an ABX protocol that was scientifically proven more than 60 years ago to be completely unsuitable for telling similar sounds apart. And they insist all the other methods are “unscientific.”

The irony seems to be lost on them.

Why do so many audiophiles reject blind testing of audio components? - Quora
128x128artemus_5
As jakleiss (who does real testing) has already pointed out:
Excuse me, I meant to write above "..blind testing is NOT a test methodology..."

All the best,
Nonoise
Passion driven undertakings are no more or less prone to real answers than purely intellectual undertakings. You are making a meaningless comparison because no "best" exists when it comes to most of the pursuits driven by our senses. There are no real answers, just opinions as there is no standard of correct/real. Further, measurements get you part of the way, but certain devices have attributes that cant be measured but sound better in many instances. Vacuum tubes would be a perfect example or tube amps if you like. Take it one step further and determine if it actually is some of the things that make it measure poorly that actually make it sound better.

audition__audio
798 posts
05-05-2021 10:20am
Passion driven undertakings are no more or less prone to real answers than purely intellectual undertakings. You are making a meaningless comparison because no "best" exists when it comes to most of the pursuits driven by our senses. There are no real answers, just opinions as there is no standard of correct/real. Further, measurements get you part of the way, but certain devices have attributes that cant be measured but sound better in many instances. Vacuum tubes would be a perfect example or tube amps if you like. Take it one step further and determine if it actually is some of the things that make it measure poorly that actually make it sound better.
There is a reason vacuum tubes sound better in many instances. One has to do with superior linearity in a well designed hifi amp/preamp. Same could be said for powering subwoofers with a solid state amp of good design.

So....you being the arbiter of "meaningless comparisons" is simply absurd.

Guidelines in engineering standards by an organization like AES means that a manufacturer just can't make up stuff that can't be proven through tests.
Measurements have real value, of that there is no doubt. I want to know how much power my speakers can handle, so I don’t destroy them. I want to know the sensitivity of my speaker to get an idea of how much power I’m going to need to drive them to a volume I would like to listen to them at. I like to know what the impedance curves are like, so I know the amp isn’t going to be too stressed by the load. I want to know what the input impedance is of my preamp or amp so I know they will get along. I want to know the damping factor so I can understand how well the amp can control the speaker. Lots of measurements matter. 
These measurements are specifications that tell you how well the components will get along, but very little about how good something will sound. That can not be measured. 
Period.

Sonic bliss, is in the ear of the beholder.

Does the system resonate with you emotionally, or not. 
Measure me that...
Post removed