2. misc-audio
  3. 1147409526

do blind tests have any practical significance

do the results of a blind or double tests have any usefulness ?

a blind ab test does not prove anything. it only states facts, namely that a certain percentage of listeners were able to distinguish the sound of one component from another.

there are many issues as to the validity of these tests.

the question, "can a listener detect the sonic difference(s) between components", is never answered definitely by one test.

suppose a blind test is administered 10 or more times to the same group of listeners. assuming the first test is replicated 9 more times, there is a chance that there may be an inconsistency between the outcomes of the test.

suppose a statistically significant percentage, say less than 60 percent, for a large sample of listeners, identifies differences between 2 components, what does that mean ?

what is the application of such a result for a prospective buyer of a component ?
mrtennis
nrchy's avatar
nrchy
2,124 posts
 
Not having been to Sue Kraft's new house I can't state it with absolute certainty, but I'm pretty sure she does not live is a vacuum!

Sue has been an audiophile for longer than I have, and has owned and auditioned a lot more equipment than most people on AudiogoN. Should she not have an idea what to expect when she auditions a pair of amps from a company that has been around for a long time and has a well established reputation. I don't know if Susie liked the amps or not, I would guess she isn't selling her currrent system to buy them! BUT that's not the issue.

Who goes shopping, or auditioning without a good idea of what they are getting into? That person would be foolish! At that point in the process a person should have a good idea of what to expect.

The blindfold is not the issue, you are questioning the integrity of the reviewer! If you want to play that game, you are certainly welcome but don't cloak it under the mantle of objectivity. Either something sounds good, or it doesn't, it doesn't matter what headgear is involved...

:o
pawlowski6132
592 posts
 
"Either something sounds good, or it doesn't..."

Correct, however, referring to my example, I will never know if these amps really sound good or not because SK is NOT giving an objective observation. Her predjudices and impartiality are clouding the review. Period. How can anyone dispute this????? She even comes right out and tells you.

I'm not questioning her integrity. She probably has lots. Or maybe none. I don't know and I don't purport to.

I'm commenting on the process which most reviewers are subject to.
cdc
1,685 posts
 
Sammie Davis Junior was good in single blind tests, however my vote would be for Stevie Wonder in double blind tests.
nrchy's avatar
nrchy
2,124 posts
 
So should magazines hire writers who have no preconceived notions about a product? Do you want to read a review written by someone who does indeed live in a vacuum???

How can someone without years of listening experience write a review??? You have sunk below the level of absurd...

:o
pawlowski6132
592 posts
 
Nrchy; You're missing the point. Sue can continue to review. Just don't tell her what's she's listening to. That's not absurd at all. Just say, Sue, you'll be listening to a solid state amp in your system. Tell us what you think.

I'm not sure how we keep missing each other on this. Doesn't this make sense?
More to discover