mkgus
But your point about being part of a listening test using an unfamiliar system is quite valid, and represents one of the many issues that must be addressed as part of designing a scientifically valid test.
One of my concerns with “on the spot” listening tests is that I need time to learn a specific system’s sound first. I can pick up on very subtle changes with my system because I am very acquainted with it. If I go to someone else’s house, I would not fare so well ... Give me enough time, which could be hours or days and I would do much better on listening tests. What I am alluding to is that if we show up at an audio show with an unfamiliar system, we could all fail a listening test and there could still be differences between cables that we miss because we aren’t familiar with the “baseline” sound.You will not "fail" a listening test, because such tests don’t actually test the listener. For that, see an audiologist; that’s what they do.
But your point about being part of a listening test using an unfamiliar system is quite valid, and represents one of the many issues that must be addressed as part of designing a scientifically valid test.