2. misc-audio
  3. 1147409526

do blind tests have any practical significance

do the results of a blind or double tests have any usefulness ?

a blind ab test does not prove anything. it only states facts, namely that a certain percentage of listeners were able to distinguish the sound of one component from another.

there are many issues as to the validity of these tests.

the question, "can a listener detect the sonic difference(s) between components", is never answered definitely by one test.

suppose a blind test is administered 10 or more times to the same group of listeners. assuming the first test is replicated 9 more times, there is a chance that there may be an inconsistency between the outcomes of the test.

suppose a statistically significant percentage, say less than 60 percent, for a large sample of listeners, identifies differences between 2 components, what does that mean ?

what is the application of such a result for a prospective buyer of a component ?
mrtennis
pawlowski6132
592 posts
 
Nrchy; You're missing the point. Sue can continue to review. Just don't tell her what's she's listening to. That's not absurd at all. Just say, Sue, you'll be listening to a solid state amp in your system. Tell us what you think.

I'm not sure how we keep missing each other on this. Doesn't this make sense?
nrchy's avatar
nrchy
2,124 posts
 
I don't think you understand the process involved in working for a magazine, or reviewing a piece of gear...

The reviewer lives alone, and has to take possession of the amps, get them into place, hook them up, andthen conduct a review. It is impossible for her not to know what is being reviewed. Reviewers don't go off to some magic island named vacuum and sit there for a few weeks to do their job. This is a part-time, supposedly fun (if you call getting reamed out by every audiophile who disagrees, fun) job for people who are otherwise gainfully employed.

You're right, it doesn't make any sense...

:o
mrtennis OP
3,295 posts
 
a reviewer should be objective when appraising the sonic merits of a component. a reviewer should be an accurate reporter of what he/she hears--no more no less.

it is counter productive for the reviewer to express a sentiment about the component reviewed. just report the facts and leave the biases and persuasion out of the review.
gregm
3,407 posts
 
a reviewer should be an accurate reporter of what he/she hears--no more no less
Quite reasonable. Which of course begs the question, "how well is the system containing the product under review, set up?"...
pawlowski6132
592 posts
 
Nrchy; point taken. It may not be practical. But, I hope you agree with me in theory at least.
More to discover