I need help to select a music streamer

Geoff, I explicitly referred to the possibility that a problem exists *of which we are unaware*.

Once again, this semantic discussion has little bearing on the evidence at hand.

Evidence is not proof. That’s precisely why one test proves nothing. Preponderance of the evidence requires multiple tests as I be already said at least twice. To be strong evidence a test must be repeatable and transferable.

Evidence is not proof. That’s precisely why one test proves nothing. Preponderance of the evidence requires multiple tests as I be already said at least twice.

I agree with this statement entirely.   All we can say is that these tests have failed to reject the null hypothesis - listeners can't tell the difference between cables/amps/resolutions using only their ears.  The point here is that there have been lots of tests, and they all fail to reject the null hypothesis.  If there were a reasonable volume of tests that could, with reasonable confidence, reject the null hypothesis, I would be, in fact, pleased to accept that as (colloquially) 'proof' of strictly audible differences.

I'm working with the compilation I've linked.  I'd love to include others if readers can bring them to my attention.

ahofer

... these tests have failed to reject the null hypothesis - listeners can’t tell the difference between cables/amps/resolutions using only their ears. The point here is that there have been lots of tests, and they all fail to reject the null hypothesis...

It’s not even remotely true that all tests "fail to reject the null hypothesis."

Perhaps one of the most famous examples is the infamous Carver challenge published in Stereophile. Its entire premise was indeed that the amplifiers sounded different, but that Carver could get his to mimic the sound of the other. He succeeded, but apparently couldn't replicate the results in actual production.

 I think Stereophile's listening  before the Carver match was sighted (ie not only with ears). Only after he matched the amps was some blind testing done.   

https://en.wikipedia.org/wiki/Bob_Carver#Amplifier_modeling
https://www.bobcarvercorp.com/carver-challenge
https://www.stereophile.com/content/carver-challenge-page-2

If I'm right that the pre-matched listening wasn't controlled, this test would only fail to reject the null hypothesis that the *matched* amplifiers were audibly indistinguishable.   It says nothing about strictly audible differences between the *unmatched* amps. An objectivist would probably suggest that Carver had the edge even before he modified his amp.

The null testing Carver employed to match amps has been used to compare expensive and generic cables right out of the box, with generally inaudible results.

But I remain interested in any *ears only* (blind) testing that rejects the null hypothesis.