2. misc-audio
  3. 1147409526

do blind tests have any practical significance

do the results of a blind or double tests have any usefulness ?

a blind ab test does not prove anything. it only states facts, namely that a certain percentage of listeners were able to distinguish the sound of one component from another.

there are many issues as to the validity of these tests.

the question, "can a listener detect the sonic difference(s) between components", is never answered definitely by one test.

suppose a blind test is administered 10 or more times to the same group of listeners. assuming the first test is replicated 9 more times, there is a chance that there may be an inconsistency between the outcomes of the test.

suppose a statistically significant percentage, say less than 60 percent, for a large sample of listeners, identifies differences between 2 components, what does that mean ?

what is the application of such a result for a prospective buyer of a component ?
mrtennis
gunbei
2,327 posts
 
I don't even like doing this with popular soft drinks.
nrchy's avatar
nrchy
2,124 posts
 
I lied about MrTennis, he's not the one who has been posting on stereophile. Sorry Mr T.

Double blind testing is a great way to determine a listeners ability to hear, but that is about all. It's not a good way to determine the value of a product.

Who buys gear based on DBT????????????????
bignerd100
515 posts
 
The small group of basement-dwelling "audiophiles" is so widely dispersed that creating a test sample large enough to produce statistically significant results is near impossible.
"What about CES?" you might say.
Sure you could gather a sample group and get your blind test. But the group would devolve into a small-scale riot over the type of wire used to run the lighting in the room or the composition of the ceiling tiles.

:)
Ag insider logo xs@2x
uru975
684 posts
 
yes but perhaps only for the blind. This being audio it is all aurally dependent not visually so
sdatch
204 posts
 
MrT, the reasons you cited are exactly why dbts are such a painful subject. Actually I should say DBTs with respect to human sensory perception, since taste tests are also notorious in many of the same ways that aurally oriented tests are. Nonetheless, I still think there is value in pursuing comparison criteria, since, in a perfect world, the DBT could be used an excellent determination of the value of a given component in the context of its peers.

Would they prove that the emporer in fact has no clothes? I don't know, but let's hope there's at least a loincloth...
More to discover