But when conducting such tests, researchers need to be sure that the test itself is truly scientific, that variables have been eliminated and that the protocol follows established practices. That's not as easy as it might seem to the casual observer. And failing to use proper protocol yields results that are completely unreliable - perhaps even more so than sighted listening.
Totally. The tests put forth are not in any way definitive. Nor are they
the test to be conducted. As silly as it sounds, the A/B/X test would have to be tested since so far, it's only been a parlor trick. There would have to be short term tests and long term tests in order to eliminate faulty conceptual constructs in the design of the tests.
Looking at what the testers demand demonstrates a skirting of any actual test and instead, conditions guaranteed to scuttle any findings that would demonstrate that there are discernible differences.
All the best,
Nonoise