Why HiFi Gear Measurements Are Misleading (yes ASR talking to you…)


About 25 years ago I was inside a large room with an A-frame ceiling and large skylights, during the Perseid Meteor Shower that happens every August. This one time was like no other, for two reasons: 1) There were large, red, fragmenting streaks multiple times a minute with illuminated smoke trails, and 2) I could hear them.

Yes, each meteor produced a sizzling sound, like the sound of a frying pan.

Amazed, I Googled this phenomena and found that many people reported hearing this same sizzling sound associated with meteors streaking across the sky. In response, scientists and astrophysicists said it was all in our heads. That, it was totally impossible. Why? Because of the distance between the meteor and the observer. Physics does not allow sound to travel fast enough to hear the sound at the same time that the meteor streaks across the sky. Case closed.

ASR would have agreed with this sound reasoning based in elementary science.

Fast forward a few decades. The scientists were wrong. Turns out, the sound was caused by radiation emitted by the meteors, traveling at the speed of light, and interacting with metallic objects near the observer, even if the observer is indoors. Producing a sizzling sound. This was actually recorded audibly by researchers along with the recording of the radiation. You can look this up easily and listen to the recordings.

Takeaway - trust your senses! Science doesn’t always measure the right things, in the right ways, to fully explain what we are sensing. Therefore your sensory input comes first. You can try to figure out the science later.

I’m not trying to start an argument or make people upset. Just sharing an experience that reinforces my personal way of thinking. Others of course are free to trust the science over their senses. I know this bothers some but I really couldn’t be bothered by that. The folks at ASR are smart people too.

nyev

@nyev ,

 

You started out with a post asserting that, and I hope I am paraphrasing correctly, that you believe we can have two things that measure identical, or close enough, but hear a difference. First, is that truly what you are asserting? 

I think measurements can provide us with significantly more information about how we will interpret how something sounds than many audiophiles give them credit to do. I think first this belief from audiophiles comes from general lack of understanding of how to interpret measurements or how to apply them. There is a lot of data in a Klippel report for a speaker. It takes some level of training, not extensive, but at least some, and definitely some experience, to read all that data and come up with a fairly good understanding of how that speaker will be perceived by most people, even more so when their room is considered.  Where this data is highly beneficial is where you have the data for the speaker you are currently using, the one you are considering, and know what you like/dislike about your current speaker.  This allows an interpretation of the measurements within a framework of the listener's preferred target sound.

I do think the most contentious thing that ASR does is make the claim for many products that the product is transparent, and not only that it is transparent, but because it is transparent, it will sound the same as this much more expensive product. I would say that question could be easily resolved with a blind format listening test, but I am now quite certain that even if that showed them to be the same, that far too many would not accept the results. I am a bit shocked by the views on blind format listening I have read here.  So I will ask you, what do you thin is an adequate and acceptable way to prove that two products sound the same?

See, all explainable.

I don't think you explained anything.  Tube always has inferior freq. response to SS amp and higher distortion but most people will favor tubes due to its more musical nature.  Of course if a bad tube amp very high distortion you can tell, but most tube amps nowaday are pretty good.

FET amp with its being a square I vs. V curve sounds more tube like but its weakness is that it is less transparent vs. Bipolar and not as dynamic.

Here is the thing.  The freq. response curve and distortion will only tell you so much.  How can measurement tell you if it is a FET amp or Bipolar amp?  But a quick listening will tell you the difference between a FET vs. Bipolar.  FET amp has gotten much better now, but in the old day it was very "hazy" vs. Bipolar.  A lot of amp now uses FET as an input stage and Bipolar at the output stage.  Just like using tube as input stage then SS as the output.

 

Also if you look at a speaker freq. response and distortion, it is an order of magnitude (or even higher)  higher than anything audio chain (amp, preamp), so  measurement would tell you that it will dominate anything in the upstream components, it is not.  You can hear the difference with different amp or preamp.

Tube always has inferior freq. response to SS amp and higher distortion but most people will favor tubes due to its more musical nature. 

 

On what do you base this claim?

I myself like my tube amps, but so what?  The vast majority of audiophiles use solid state amplification and are very happy with it.  (And that includes many who have compared with tube amps, or who had previously owned tube amps).

 

The "haze" that you keep speaking of remains completely anecdotal so it doesn't really address Amir's points about how to reliably make such determinations.

 

On what do you base this claim?

I myself like my tube amps, but so what?  The vast majority of audiophiles use solid state amplification and are very happy with it.  (And that includes many who have compared with tube amps, or who had previously owned tube amps).

That is because a good tube amp will cost a lot more money compared to a SS amp.  To get the same performance you need to spend quite a bit more.  If money is not an issue, most people would go with tube.

The "haze" that you keep speaking of remains completely anecdotal so it doesn't really address Amir's points about how to reliably make such determinations.

The "haze" is there.  In the old day it is very apparent in SS amp, but now SS has gotten a lot better so you don't notice it as much but a listen vs. a good tube amp will reveal it.  FET amp tends to be guilty of this more so than Bipolar.

Look if SS is so perfect than nobody would use tubes.  But SS has its flaws but people will ignore it since it can output a lot more wattage vs. tubes.