2. misc-audio
  3. 1147409526

do blind tests have any practical significance

do the results of a blind or double tests have any usefulness ?

a blind ab test does not prove anything. it only states facts, namely that a certain percentage of listeners were able to distinguish the sound of one component from another.

there are many issues as to the validity of these tests.

the question, "can a listener detect the sonic difference(s) between components", is never answered definitely by one test.

suppose a blind test is administered 10 or more times to the same group of listeners. assuming the first test is replicated 9 more times, there is a chance that there may be an inconsistency between the outcomes of the test.

suppose a statistically significant percentage, say less than 60 percent, for a large sample of listeners, identifies differences between 2 components, what does that mean ?

what is the application of such a result for a prospective buyer of a component ?
mrtennis
bignerd100
515 posts
 
The small group of basement-dwelling "audiophiles" is so widely dispersed that creating a test sample large enough to produce statistically significant results is near impossible.
"What about CES?" you might say.
Sure you could gather a sample group and get your blind test. But the group would devolve into a small-scale riot over the type of wire used to run the lighting in the room or the composition of the ceiling tiles.

:)
Ag insider logo xs@2x
uru975
684 posts
 
yes but perhaps only for the blind. This being audio it is all aurally dependent not visually so
sdatch
204 posts
 
MrT, the reasons you cited are exactly why dbts are such a painful subject. Actually I should say DBTs with respect to human sensory perception, since taste tests are also notorious in many of the same ways that aurally oriented tests are. Nonetheless, I still think there is value in pursuing comparison criteria, since, in a perfect world, the DBT could be used an excellent determination of the value of a given component in the context of its peers.

Would they prove that the emporer in fact has no clothes? I don't know, but let's hope there's at least a loincloth...
dopogue
1,773 posts
 
All you dead-horse beaters, arise and smite :-)
gammajo's avatar
gammajo
846 posts
 
To do this right is very difficult. Read the book Blink to get an idea of how humans form judgements. From psychology we know that people will preceive coffee from a red can as richer and more full bodied than the same coffee from a green can. Every single thing that is said to the subject, every thing in the enviroment, the order things are presented in, and even the lead experiementers beliefs, even when double blind designs are used influences the results.
More to discover