Lush, I think the real question is what constituted a valid measure of whether people can hear a difference between cables, etc. There is much criticism of the typical "same/different 30 second exposure" method. It certainly does not correspond to real life circumstances, although it is easy for researchers. There should be no concern about making it easy for researchers, however, only on reaching agreement about valid measures.
Since you cannot "accept" as hypothesis as only one instance that disproves it suffices to reject it. So the normal hypothesis is a null hypothesis that researchers want to "reject." Blind test advocates "want" to "accept" the null hypothesis, cables make no difference, however, thus as you suggest a single instance disproves it. I single person hearing differences would cause it to be rejected.
No one seems to want to deal with a widely accepted "valid" measure of whether anyone can hear differences.
Having been involved several times in double blind tests, I can personally say that I did not like the 30 second tests, but afterwards with long exposure, still not able to see what was playing, I could consistently express a preference. One time I participate in a double blind test of five preamps. We listened for a long time and personally rated the preamps. Afterwards, the average rating of the preamps was announced. I went to the trouble of getting one for use in my home system. I hated it as I did in the test.
I think you can see that I have no interest in blind test, except when I am bored and entertained by getting involved in one.
Since you cannot "accept" as hypothesis as only one instance that disproves it suffices to reject it. So the normal hypothesis is a null hypothesis that researchers want to "reject." Blind test advocates "want" to "accept" the null hypothesis, cables make no difference, however, thus as you suggest a single instance disproves it. I single person hearing differences would cause it to be rejected.
No one seems to want to deal with a widely accepted "valid" measure of whether anyone can hear differences.
Having been involved several times in double blind tests, I can personally say that I did not like the 30 second tests, but afterwards with long exposure, still not able to see what was playing, I could consistently express a preference. One time I participate in a double blind test of five preamps. We listened for a long time and personally rated the preamps. Afterwards, the average rating of the preamps was announced. I went to the trouble of getting one for use in my home system. I hated it as I did in the test.
I think you can see that I have no interest in blind test, except when I am bored and entertained by getting involved in one.