What covid research can teach us about audio measurements.


Recent studies in Canada for patients with so-called long covid show us on how science and measurements and research actually works.

Patients with long covid suffering from limited ability to exercise passed most "normal" tests but it took a new type of test to positively identify a mechanism that explained why the patients suffered.

 

Honestly there is a lot of snake oil and charlatanism in our hobby, and I don't claim to discount that fact.  What I do want to say is that science doesn't rest with 50 year old measurements.  It evolves to measure and explain constantly. 

The reason I am personally dissatisfied with audio measurements in the common literature is exactly because of this stagnation, and when these fail us we trust our ears and gut for lack of better tools. 

Anyone who runs the same 20 measurements on an amplifier or DAC and claims it is science and that these measurements are all that can be known is fooling themselves into believing that they are scientists or that we have reached the limits of understanding.

And above all, caveat emptor!

erik_squires

 

@erik_squires 

The appeal to the old "science doesn't know everything yet" is one used as a partial justification by every pseudo-scientific/supernatural/fringe belief system.

It's an exceedingly weak justification for believing in dubious ideas.

The patent offices are full of patents for Perpetual Motion Machines by the folks saying "Science doesn't know everything!"   It doesn't make claims for a perpetual motion machine an inch more credible.  What WOULD make it credible is actual evidence such a machine could or does work!  Otherwise you just join the extensive line up of people thinking "I've discovered a new reality" and grumbling about how science just won't recognize their claims.

So, take a conversation I (and others) had with an audiophile who spent over $1,000 on a "high end" HDMI cable to replace his off-the-shelf HDMI cable.  He claimed it made the image obviously sharper, obviously richer in color and higher in contrast.

Now...this is literally impossible given how HDMI cables work. He had not upgraded from an old spec HDMI cable to a newer 4K spec'd cable, and hence this was not due to a variable like he was now passing through 4K/HDR images where he wasn't before.  The claim was that these were the same spec cables, the original was working, but the new one, as claimed by the company that sold it to him, "improved" the picture quality.   It was pointed out this was impossible (unless they had inserted an active chip to alter the image, and didn't tell anyone). 

In evaluating such a claim, what is more plausible?  That this individual had discovered that the very theory by which HDMI works, the very theory that has allowed the successful manufacturing and deployment of that technology the world over for many years...is actually wrong?  Or...given the fact that every human being has the propensity for bias to affect their perception...that his perception was influenced by a bias effect?   This is similar to choosing between the likelihood that someone had really made a perpetual motion machine in their garage, overturning basic physical theories, vs their claim being error or bullsh*t.

Nobody makes a dubious claim more likely by crying "But Science Doesn't Know Everything!"

And when you mention "50 year old measurements" that can be a feature, not a bug!  If someone wants to say the electronic measurements that have, for instance for cables,  been so reliable, and used with predictable results in such a truly vast array of situations around the world...that these ways of measuring are "wrong" or "insufficient" then they take on a substantial burden of proof!

Anecdotes of "I'm sure I heard something" will hardly do!    They should at least offer plausible explanations to begin with (and not ones that can be easily undone by someone with expertise in the field) or failing that at least demonstrate that they CAN actually hear this difference they claim.

In other words, can they hear the difference when they are not peeking?  In blind tests controlling for sighted bias?   That's a component that your OP misses as well.  Measurements aren't the only tool in the box.  One can indeed demonstrate something can be heard that isn't showing up in measurements.  But given the consequences of such a claim, it makes sense to first establish people ARE REALLY hearing this difference, under controlled conditions.

Of course, we can all think we hear whatever we do, and practice this hobby however we want!

 

But...if someone claims to hear things that are dubious under current theories of electronics and human hearing thresholds, and offers no objective/testable evidence, nor any testable claims (won't show it via blind tests), then they have only themselves to blame for just shouting in to the wind, and placing themselves in the long line-up of fringe theories which also have not passed any of the normal crucibles for reliable knowledge.

 

 

 

 

 

 

 

 

 

 

@prof

 

There is a big difference between doubting science and doubting that measurements tell you what they were never meant to tell you in the first place. Much of pseudo-science actually starts off with some modicum of truth or scientific fact and then goes somewhere it has no right to.

Those absorbed with a handful of audio measurements that are in the public consciousness are very much in this space.

erik,

But that is a pretty vague claim.

If for instance someone is measuring a cable, or an AC cable, or a USB cable, and

finding "there is no difference in the signal"...and someone wants to say "Actually, you are missing something" it behooves that person to actually explain what they are missing.  And if possible suggest how to measure instead.

But if it's all vague hand waving, like "maybe there is something people are hearing that you aren't measuring for"...then what does that give anyone to work with?

How does that help discern nonsense claims from plausible claims?

@prof

There was a post here a while ago from a psychologist/researcher who aptly collected what I keep trying to say.

A measurement of THD is a measurement of THD. A measurement of frequency response is a measurement of frequency response. To extend those measurements beyond that is not science, it is pseudo science. To take those measurements and discuss "ideal" or the end of all things that can be heard is not science. It is also not science to repeat measurements and rank equipment based on them. That is quality assurance.

It is also not science to lump average human perceptions and claim this is how 1 individual hears.

There is no scientifically agreed to set of measurements which together describe all the human ear/brain is capable of hearing. All we have is a minor number of measurements which are in popular (well, as popular as audio is) culture.  I doubt those measurements which Stereophile publishes, are even close to all that is used in modern engineering and development.

As for the rest, caveat emptor, but I won’t hide under the umbrella of science when I’m actually ignorant.

Best,

 

Erik