Article: "Do Blind Listening Tests Work? My Sessions with the Colorado Audio Society"

@sns 

As for myself and I suppose for most if not all, this audio endeavor is not like some pharmaceutical that could save my life. I don't need or care about some rigorous peer approved double blind study to provide evidence that my chosen audio system and/or components may or may not be objective references. My audio system/placebo makes me feel good, and I'm not going to suffer a single bit knowing its only a placebo.

I agree. The kind of "bias" I am looking to eliminate is the one where I *think* I like something the best and someone helps me see I'm missing something else that I like better.

For example, when I first listened to some B&W bookshelf speakers at a store, I thought they sounded the best. A friend was with me and pointed out that they were rather on the "bright" side and that they could become fatiguing. He pointed out that I should pay more attention to the midrange, where the voices were, and to consider that as important. So, my "bias in favor of bright shiny highs" was eliminated and a different, more justifiable, preference (for my taste) took its place.

As you've pointed out, one doesn't need a double-blind study to mature one's appreciation of what's important.

@newton_john You bring up the very thing I was going to speak to next. Thus far we've mostly been speaking to the playback side of the equation, think about all the variables that go into the recording side of the equation. And then we have the instruments themselves, many require amplification, another relatively unknown variable, and how about synths, and even acoustic instruments have their own individual sound signature. And don't forgett about the media, streaming. Bias and massive amounts of variables are inherent to the entire undertaking of recorded music and playback of those recordings.

Still, for those who insist on applying or attempting to apply an objective reference to these endeavors one could develop this theoretical reference listening bot with no biases, and with every variable accounted for. This bot would develop reference instruments, recording chain and playback chain components/system, you would then be assured of having an objectively determined reference audio experience. Nah, me thinks I'd rather attend to my biases, and I actually find the nearly endless variables fascinating. Isn't tweaking the sound the very essence of being an audiophile, I be entirely bored with the bot making all the choice for me.

From my perspective double blind testing is an attempt at making us into that theoretical listening bot, this a delusion that we humans can be these objective arbiters for determining reference components. I do believe we can become more discerning listeners and double blind testing may serve a purpose here, but us as objective listeners/arbiters, that is a whole other can of worms.

I cannot add something better to say over ghdprentice  and sns 
Thanks

@sns 

Responding to your comment up a few posts on why so many different sounding systems... Well, I think most folks don't start off with the big picture. I certainly did not. I had a system... I loved the sound of a kick drum, and loved to crank it up to "concert levels" (young and stupid era). So, I went out listening to equipment and bought stuff that sounded good. I continued this for a couple decades as I learned the lingo and became enamored with soundstaging, micro details, air, etc. I had no reference... I was not wealthy, I didn't hear acoustic music and only occasional rock concerts... a source of some of the worst (but loud) sound quality... drugs help. The best system I had heard was a Rowland / Wilson ($500+K) perfectly set up. Holographic... but sounding nothing like real music. I loved listening to it... but I did not want to own it. Many people love this sound and want it in their home. I get it. Sonic spectacular. 

I slowly realized that there were dead ends and that my system could loose the music. That is when I stepped back and realized I needed an empirical ruler. I started listening to real music. I realized what my system was missing and I headed down the path to construct a musical system. 

So, there are many other paths to take. Nothing wrong with them... they just are not attempts to recreate the real thing. 

@newton_john 

Good to hear about your Linn experience. I have noticed a trend (I think) in more equipment getting better rhythm and pace. I noticed it in the most recent generations of Pass x and integrated amps. I am happy to hear Linn amps are getting better. Maybe this is the new thing that designers are figuring out how to get better rhythm and pace in solid state amps... more tube like.