Why HiFi Gear Measurements Are Misleading (yes ASR talking to you…)


About 25 years ago I was inside a large room with an A-frame ceiling and large skylights, during the Perseid Meteor Shower that happens every August. This one time was like no other, for two reasons: 1) There were large, red, fragmenting streaks multiple times a minute with illuminated smoke trails, and 2) I could hear them.

Yes, each meteor produced a sizzling sound, like the sound of a frying pan.

Amazed, I Googled this phenomena and found that many people reported hearing this same sizzling sound associated with meteors streaking across the sky. In response, scientists and astrophysicists said it was all in our heads. That, it was totally impossible. Why? Because of the distance between the meteor and the observer. Physics does not allow sound to travel fast enough to hear the sound at the same time that the meteor streaks across the sky. Case closed.

ASR would have agreed with this sound reasoning based in elementary science.

Fast forward a few decades. The scientists were wrong. Turns out, the sound was caused by radiation emitted by the meteors, traveling at the speed of light, and interacting with metallic objects near the observer, even if the observer is indoors. Producing a sizzling sound. This was actually recorded audibly by researchers along with the recording of the radiation. You can look this up easily and listen to the recordings.

Takeaway - trust your senses! Science doesn’t always measure the right things, in the right ways, to fully explain what we are sensing. Therefore your sensory input comes first. You can try to figure out the science later.

I’m not trying to start an argument or make people upset. Just sharing an experience that reinforces my personal way of thinking. Others of course are free to trust the science over their senses. I know this bothers some but I really couldn’t be bothered by that. The folks at ASR are smart people too.

nyev
andy2

1,504 posts

Looks like Amir is gone?

I doubt it. Wait for the next commercial blitzkrieg here shortly.

Besides, even if he is gone, it’s OK. Cin Dyment (aka The Speaker Dude nowadays) can handle the entire forum single handedly

 

 

@nyev 

I know the argument remains unresolved - are these things in my mind, or is it that science has not yet figured out how to measure certain things that we perceive in audio?

We can't measure what you perceive.  You listen to a track that brings you joy.  We can't measure joy.  What we can measure is the sound coming out of your audio gear.  That is the sound that is "heard."  What is perceived includes many other variables that go beyond sound. I enjoy watching my Reel to Reel play music.  It brings me joy.  But that has nothing to do with the sound.  The sound is excellent but I hear background noise which is not so nice -- something we absolutely measure.

Put more strongly, you have to identify what is sound and only sound in your perception.  You can't look at something, and give an opinion because your knowledge of what you are seeing pollutes your perception.  A person not likely horns will dislike any horn speaker.  Put them in a blind test though, and they won't bring such preconception to the party.  To wit, I was shocked how good these JBL horn speakers sounded in double blind tests at Harman that I took:

So bottom line, bring us an experiment where only the sound is evaluated and shown to not be random outcome and I will show you a measurement for it.  The moment you include other things, we can't measure it due to no fault of science, measurements or engineering.

And oh, there is no science being developed to determine what you state.  The science is completely settled that only results of controlled audio tests matter. where only your ear is involved.  All else is not worth even looking at.

@amir_asr , I thought you had given up on the discussion and I would not at all have blamed you if you had! Thank you for responding. Below are three examples where I experienced subjective differences in sound and I genuinely wonder if you would be able to measure the differences I was perceiving. If your conclusion is that no, these perceptions are due to mental bias, that will not offend me one bit. I will disagree with you if that is the case, but I won’t be offended or defensive! I would also ask, how can you be sure you are measuring the right things, the right way, to explain the differences I am perceiving? That question IS rhetorical, as I would argue that no one can answer that question conclusively.  I don’t expect to convince you and I don’t expect to be convinced, but I’m interested in a constructive dialogue simply to explore perspectives differing from my own.

 

Just to give one recent example to relate to my prior post: Last year I bought a second USB cable (Audioquest Diamond) while I had the original for a few years. The new one sounded inferior. To the degree that I wondered if there was a design change or changes to production. But after a few hundred hours, I could no longer tell them apart. Yet existence of burn-in is endlessly debated.

Another recent example is what I found with length of USB cables, where a Nordost Valhalla 2 2m cable sounded superior to the equivalent 1m cable. Intuitively I would have expected the 1m cable to sound better, as I had not at that time read the theories, to my knowledge unproven, that USB cables should be longer than 1.5m to accommodate “reflections”.

And I don’t know if this one is proven or if people just have theories grounded in science, but the whole anti-vibration/isolation tweaks that really do make a surprising difference. I introduced a friend who is newly into HiFi to Herbie’s Tenderfeet, and he promptly cut up some yoga mats to replicate the benefits himself. He tells me it worked! It’s easy to identify whether the feet were added or removed, at the transition points.

I wonder, would @amir_asr be able to measure the differences I’m hearing, in each of these example cases? Not a rhetorical question; I’m genuinely curious. If the answer is no however, I think the assumption might be that it’s all in my mind. Just like what the researchers said about those hearing meteors, 25 years ago, because they were not measuring the right things or applying the right science to explain our perceptions.

I should also mention I had the exact same experience as with thenNordost USB example, testing a .7m Audioquest Diamond against a 1.5m version of the same cable.

@andy2 

That is true in theory but I don’t think Amir even doing that. But jitter is difficult to test in frequency domain, just to name a few.  There are more.

We don't "measure" jitter in time or frequency domain.  Jitter modulates the primary tone that we can play.  We perform a spectrum analysis of that tone and jitter sidebands jump right out:

See those sidebands at whopping -130 dB.  We can easily measure them by simply sampling the analog output of the DAC.  No need to probe inside which is problematic anyway as the DAC chip likely has jitter reduction.

As a major bonus, we can apply psychoacoustics analysis to the jitter spectrum and determine audibility as you see noted on the graph.

The other thing is that jitter is not one number as is often talked about.  Above you see multiple jitter sources at different frequencies and levels.  This makes FFT analysis far superior to any time domain jitter measurement that spites out either a number or even a distribution.

FYI, my audio analyzer has a time domain jitter meter but it is nowhere near as good as the above spectrum and at any rate, only works on digital sources, not analog.