Have You Ever Put Your Golden Ears to the Test??


First let me say that I'm not one of the naysayers that Twl refers to in his thread about "Sonic Relativism", so please no attacks. I have no agenda.

I'm just curious if any of you have (or would be willing to) put your ears to the test in the way of a blind comparison. If so, what were the results? It can be quite rewarding to know that you can discern differences between things such as cables, DACs, etc.

I was at a good friend's house this weekend and we decided to do some blind comparisons of CD vs. SACD. We had three discs of various types of music (Friday Night in San Francisco, Keb' Mo and Harry Connick Jr.). I sat in the sweet spot and my friend switched discs playing one cut from each disc CD/SACD at random.

I could discern the CD from the SACD every time, but I have to say that the differences were more subtle than I expected. Of course, I'm no scientist so my methods may be open for scrutiny. I'm just curious how many of you try similar tests?

I always find it interesting when people say that they "heard" a cd player (or other component) and it was really great or really crappy or not very exciting. This almost always refers to having heard it at a dealer. How do they know they didn't "hear" the other components? What's the point of reference? The only way to really listen to components or accessories is within the confines of a "reference" system. For most of us that simply means our own system. And even then, the only way to confirm that we're hearing what we "think" we're hearing is to do some sort of blind test.

So...How many of you have put your ears to the test? If you haven't...Would you? If not...Why not?
danheather
Good point Newbee. There has to be a "reference". You must be listening to equipment that you're familiar with in an environment with which you're also familiar. I would tend to agree that "double-blind" testing performed by people who don't even know what they're listening for (Twl pointed this out elsewhere) is flawed at best and completely worthless.

What I'm referring to is conducting your own "in-home" blind testing where there is a point of reference and, hopefully, some relatively skilled ears listening for the most subtle of contrasts.

I've listened pretty extensively to my friend's system (almost as much as my own!) so I'm comfortable with using it as a reference. Additionally, my friend doesn't make nearly as many changes to his system as I do, so it's been pretty constant for a long time.

P_mmk also raises a good point about people make hyperbolic claims such as "the best" or "blows you away". I have heard people say such things about SACD which was one of the reasons that I wanted to conduct our informal test. While there was certainly a difference, it was not as obvious as I would have hoped.

Imagine the reaction people had to color television when it came out. Cable vs rabbit ears. Digital cable/satellite vs analog. DVD vs VHS. HDTV vs conventional broadcast. In the visual medium the changes are more obvious.

Ours is a hobby of incrementalism. This is all the more reason that we should be training our ears. It's easy to say that I hear a difference, but harder to prove. I'm not suggesting that I need to prove it to somebody else. I want to prove it to myself.
Every time I make a change. Sometime during my mis-spent youth I suffered brain damage that affected my short term memory (you know like forgetting where you put your car keys). So every time I switch one cable for another or one component for another, by the time I get back to my couch I can't remember what it is I'm listening to.

Actually, I don't know anyone in my real life who would have any interest in doing the switching for me, nor am I sure I would be interested. I am perfectly happy deciding for myself that the new amp I bought sounds better than the old one. I trust myself to do this, because, for example, I have brought amps home to audition and determined on a sighted basis that if there was any difference, I couldnt tell or it was so subtle that I did not need to make the purchase. I have no interest in impressing anyone or any part of my ego invested in my hi fi equipment (I didn't design the stuff).

What I have said recently, and have heard privately from some real pros, some well known, is that properly designed inexpensive late model amps and cd players get the job done as well as expensive stuff, and no one has published a report of a rigorous blind test that shows otherwise. I wasnt really happy when one of my favorite reviewers told me that there isnt much of a difference between my expensive cd player (I paid a little more than 1/2 the retail) and a NAD. I dont even agree with him. But I wouldnt want to put any money on my belief.

The other thread to which you refer is hilarious. The author turns everything on its head. Scientists and professional engineers use double blind testing all the time, but he calls DBX "pseudo-science." The camps are usually divided into scientific objectivists (those who argue for DBX tests and say all cables and properly functioning amps sound the same) and subjective relativists (audiophiles who believe that everything sounds different), but the author of that thread calls people championing an objective scientific approach "subjective relativists." There is no way to begin to have an intelligent conversation on the subject

I am not one of them, but I respect the scientists and engineers I know who advocate DBX testing of audio components. I dont see how you could find fault with them. They're trying to save you money and redirect your attention to things that really matter - speakers and room interaction.
How could anyone clinging to an argument which is easily overturned by simple auditioning, be considered "scientific objectivist"? I would offer "dogmatic pragmatist" as a more accurate description. The term subjective relativist does apply to them because the testing used is subject to their subjective "statistical analysis" of their conclusions, which are, in fact, skewed by the attempt to make the analysis conform to their preconcieved notions.
I offer as a refutation, the vast bulk of the audiophile community, who have voted on this matter with their dollars to purchase equipment which does sound better than their previous gear. I cannot accept the (scientific objectivist) notion, that we are all in a state of mass-hypnosis, causing us to make expensive purchases for no gain. This is absurd to say the least. Should we not believe what we see because of "psycho-visual" implications, or disbelieve what we touch because of "psycho-tactile" ones? Why not? We are being asked to disbelieve our ears because of "psycho-acoustic" reasons. But some people are just more "informed" than you and me, don't you know?
paulwp, i'm highly suspicious of anyone trying to save me money when i don't hire them to do so - i really think their pushing their own agenda. while i respect engineers and scientists, as well as physicists, doctors, whatever, remember that science itself is a moving target, that it is constantly changing depending on the developement of new facts, laws of nature, theory, etc. a closed minded professional is much more dangerous that the most sujective idiot as people will take the professional seriously - what he sez can seem to make so much sense(!)especially if thats what you are predisposed to hear.
danheather & p_mmk, couldn't agree with you more re hyperbolic comments regarding equipment differences - when i see this i quickly turn the page - it just ell me that the write has something to sell (philosophically or actually).
I have been able to tell differences in equipment before. But, like most said, sometimes I can't. Some differences grab your attention and some just pass you by, I suppose.

Off topic but interesting: My friends and I were drinking beer a few weeks ago (not my favorite drink, but I am familiar with it) and we noticed that we had several different brands of which we thought we knew their characteristics. Some were imports, some were domestics, and some were microbrews; both cheap and expensive. We began pouring each other glasses and not revealing the brand. On many occasions we had no idea what we were drinking. And, oddly, some of us said that we liked the test beer and found out that it was a brand we previously stated we disliked.

I don't know...Maybe all that beer made it seem more interesting at the time.

Brad Day
Atlanta, GA