Why HiFi Gear Measurements Are Misleading (yes ASR talking to you…)


About 25 years ago I was inside a large room with an A-frame ceiling and large skylights, during the Perseid Meteor Shower that happens every August. This one time was like no other, for two reasons: 1) There were large, red, fragmenting streaks multiple times a minute with illuminated smoke trails, and 2) I could hear them.

Yes, each meteor produced a sizzling sound, like the sound of a frying pan.

Amazed, I Googled this phenomena and found that many people reported hearing this same sizzling sound associated with meteors streaking across the sky. In response, scientists and astrophysicists said it was all in our heads. That, it was totally impossible. Why? Because of the distance between the meteor and the observer. Physics does not allow sound to travel fast enough to hear the sound at the same time that the meteor streaks across the sky. Case closed.

ASR would have agreed with this sound reasoning based in elementary science.

Fast forward a few decades. The scientists were wrong. Turns out, the sound was caused by radiation emitted by the meteors, traveling at the speed of light, and interacting with metallic objects near the observer, even if the observer is indoors. Producing a sizzling sound. This was actually recorded audibly by researchers along with the recording of the radiation. You can look this up easily and listen to the recordings.

Takeaway - trust your senses! Science doesn’t always measure the right things, in the right ways, to fully explain what we are sensing. Therefore your sensory input comes first. You can try to figure out the science later.

I’m not trying to start an argument or make people upset. Just sharing an experience that reinforces my personal way of thinking. Others of course are free to trust the science over their senses. I know this bothers some but I really couldn’t be bothered by that. The folks at ASR are smart people too.

nyev

@mastering92 

Would you consider having your test results/measurements verified by other industry experts? I don’t see a problem with that. If I were you, I would welcome 3rd party validation of my work. 

Consider it?  That is like asking a Chinese person if he would consider eating rice!  My measurements get verified by manufacturers every day of the week and twice on Sunday.  You think these companies just lay low and ignore what I am producing?  

Countless companies have asked for my Audio Precision project files and I happily provide it to them so that they can make the same measurements.  To the extent I have a relationship with a company, I even offer the measurements for them to verify prior to publication.  Here are some quick examples staring with a German company you should know: Neumann:

"EDIT: received an overlay of Neumman measurements and mine:

Here is Denon:

 

"I grabbed a preliminary set of measurements from the DAC section of the 3800H and ran it by the company. Within typical margin of error, the measurements were the same as company's own."

Here is American company RSL:

 

"I was contacting the company regarding another product so while I was at it, I asked them to review the frequency response measurements. They are generally in agreement with the results you are about to see."

We also have heavyweight reviewers and engineers with their own measurement gear verifying my work.  Here is Seymore who writes for AudioExpress: 

"If there’s anything in his data that you think he’s hiding, then request the AP project files. When I have, Amir has cheerfully provided them."

Seymore has also tested some of the same units I have with same results.  In this case the designer of a phono stage claimed my measurements were wrong so with permission of the owner, I sent the unit to SIY (Seymore):

"As you can see by comparison, our measurements correlate quite closely (though we use opposite numbering for our channels, which I'll blame on my Hebrew education, learning to write from right to left). So I can proceed without worrying about major inconsistencies."

It is also not hard to replicate my measurements after seeing them.  Such is the case with Professor "Wolf/L7" in China where he tests domestic products that I also happen to test.  Results are almost always in agreement.

I also helped another reviewer (Erin) who had gotten a Klippel NFS measurement system to get up to speed by sending him the very sample I had tested (JBL monitor).  

Really, there is nothing to hide here.  I put out these measurements with full expectation that they will be scrutinized both on ASR and by manufacturers and other testers.  If you have a third-party in mind to verify my results, I am happy to send them one of my tested samples for them to re-test.  You pick the place, make it worth their while to do the testing and I will do the rest.

I suggest reading ASR for a while and to better understand what we do as to not ask questions for which there are trivial answers.

@thespeakerdude  how would you know if say an amplifier is audibly transparent in a listening tests when listening through speakers or headphones when no headphones or speakers are transparent?

 

Take this from a different standpoint. If speakers and headphones are so lacking in transparency, how could you ever differentiate two amplifiers that are much more transparent than what they are connected to. Looking at it another way, two amplifiers must be significantly different such that they can be differentiated when connected to a typical loudspeaker.

 

That is like asking a Chinese person if he would consider eating rice!

If I were a Chinese, I would find this very insulting. And dare I say, racist. But I am not Chinese, but are you? If you are of Chinese descent, even if one of your one of your great great parents, you are absolutely excused 

 

@amir_asr please change the wording before time runs out.

I am very curious, what happened with your initial measurements of Vinnie Rossi linear power supply and his subsequent success later on with his power amps and highly priced integrated amps? He “fixed” it?

 

 

@invalid 

@thespeakerdude  how would you know if say an amplifier is audibly transparent in a listening tests when listening through speakers or headphones when no headphones or speakers are transparent?

Answering for him :), you look at measurements.  If frequency response is flat and independent of load, has distortion and noise below threshold of hearing, then you can very confidently declare is transparent.  This analysis assumes perfect speakers.  To the extent the speaker is not, then the job gets easier and hence the reason amps with noise and distortion above threshold of hearing are also declared as transparent.

If anyone challenges you saying they hear the difference on their speakers/headphones, then you can perform a level matched blind testing test.  if they can't prove any audible difference in such a test, then the case is closed with respect to their claims.

Post removed