geoffkait
But let's not throw the baby out with the bathwater. While I've stated many times that I think the typical audiophile has little use for scientific listening tests - they're time consuming, cumbersome, sometimes frustrating and tedious - that doesn't mean they have no value whatsoever. But when conducting such tests, researchers need to be sure that the test itself is truly scientific, that variables have been eliminated and that the protocol follows established practices. That's not as easy as it might seem to the casual observer. And failing to use proper protocol yields results that are completely unreliable - perhaps even more so than sighted listening.
Mutually agreed terms, even with lawyers involved, are no insurance whatsoever that the results of a listening test mean anything if the results are negative.Quite so. Nor does it necessarily mean anything even when the results are positive. And lawyers are certainly not required to develop a scientifically valid test protocol.
Even if both participants are experienced audiophiles they are subject to the laws of listening tests ... If it were true that all you needed was mutually agreed terms then any two knuckleheads who wanted to “prove” some particular controversial tweak a hoaxAgreed.
But let's not throw the baby out with the bathwater. While I've stated many times that I think the typical audiophile has little use for scientific listening tests - they're time consuming, cumbersome, sometimes frustrating and tedious - that doesn't mean they have no value whatsoever. But when conducting such tests, researchers need to be sure that the test itself is truly scientific, that variables have been eliminated and that the protocol follows established practices. That's not as easy as it might seem to the casual observer. And failing to use proper protocol yields results that are completely unreliable - perhaps even more so than sighted listening.