2. misc-audio
  3. 1147409526

do blind tests have any practical significance

do the results of a blind or double tests have any usefulness ?

a blind ab test does not prove anything. it only states facts, namely that a certain percentage of listeners were able to distinguish the sound of one component from another.

there are many issues as to the validity of these tests.

the question, "can a listener detect the sonic difference(s) between components", is never answered definitely by one test.

suppose a blind test is administered 10 or more times to the same group of listeners. assuming the first test is replicated 9 more times, there is a chance that there may be an inconsistency between the outcomes of the test.

suppose a statistically significant percentage, say less than 60 percent, for a large sample of listeners, identifies differences between 2 components, what does that mean ?

what is the application of such a result for a prospective buyer of a component ?
mrtennis
btstrg
185 posts
 
Magic Island named vacuum, can I get directions to this place?
Nrchy Thank you!! You added a nice laugh to an otherwise long day!
I still do want directions though, as I am a tube guy.LOL
nrchy's avatar
nrchy
2,124 posts
 
As a tube guy I don't think you would be welcome on the magic island of Vacuum, you're living in the past!!! : )

MrTennis, People want reviews to be inviting, and so reviewers offer personnal anecdotes to pull the reader in, this is all IMNSHO Ms Kraft did in her review. I could be wrong, since I have not read the review, but I think the attacks on the writer are unwarranted. No one knows the experience or intention of the writer except the writer. To subject her to your prejudices is the worst type of STEREOtype... and to remove all value from this or any other review.

:o
mrtennis OP
3,295 posts
 
hi nrchy:

personal anecdotes are ancillary to the review. all of the preliminary repartee has no bearing on the review.

in some of my articles, i use poetry and engage in expostulary philosophical remarks. my reviews are dsiapassionate. i try not to influence the reader.

you may read my reviews on audiophilia.com . currently you can peruse a write-up of the 2007 ces show.
Ag insider logo xs@2x
dbphd
1,630 posts
 
MrTennis,

I'm surprised by your question and your assertions.

You should know that forced choice tests are the only scientifically valid kind of tests, even though it may be impractical for evaluating audio equipment. If you can't reliably distinguish among two or more conditions (amps, power cords, or whatever), I have no interest in hearing your subjective chat about how superior one is over another. But high-end audio is so full of mysticism the last thing that is wanted is objective evaluation. The emperor may in fact have no clothes.

So, yes, blind tests can be useful, but difficult to implement. I suspect most manufacturers do such testing to evaluate proposed improvements in their own products and to compare their products with a competitor's. I've certainly spent my time in labs doing blind listening tests -- worst of all is testing in a deep LF anechoic chamber, very uncomfortable feeling.

db
pawlowski6132
592 posts
 
Nrchy; do you have a crush on Sue Kraft??????
More to discover