Wow. Interesting thread. Thank you, @amir_asr for clearly explaining things from your point of view. I visit ASR fairly often and I appreciate the work you do.
I'm in a sort of no-man's land regarding this hobby. I'm a scientist by training and I believe in testing methodology that removes bias to the greatest possible extent. I eat a handful of prescription drugs every day and I'm grateful that they were all evaluated using a double-blind process. I have two neighbors/friends who didn't accept the science on Covid vaccinations and they are dead now from Covid.
I have been able to internalize quite a bit of cognitive dissonance in this hobby. I can't hear the difference between interconnects and power cords but I sure can hear the difference between amplifiers (my speakers are quite difficult to drive). I have three DACs and I suspect I could not tell them apart in a blind test but that didn't stop me from spending a lot of money on them, at least one in particular.
When I compare two pieces of gear, I don't have the capability to do an A/B/X test but I always use a control. For example, when I listen to a new set of interconnects I start by comparing two DACs in my system and I evaluate the differences, if any, using the same brand of cables, typically Blue Jeans. Then I change the interconnects in one DAC and listen again. To be thorough, I leave the new cables in place for a few months so that I can go back again and again to see if I can hear a difference (hey, you never know if maybe the wires had to break in before they bloomed). I have utterly failed to hear the differences between interconnects, even silver ones, using this method. BTW, the DACs sound very similar too.
I am prepared to spend significant funds on a component on the basis of pride of ownership even if I doubt it will sound significantly better than something cheaper. But ASR provides excellent data that helps me make a decision. I look at Amir's work as basically answering the question, "Is this product well engineered?" I'm more likely to buy a product that is designed and measures well than one with obvious shortcomings.
My feeling is that if people hear dramatic differences that can't be substantiated through scientific means then more power to them. It's their money and they should spend it on things that make them happy. In my case I know that I am susceptable to bias so I try to control it the best I can. IMO ASR provides a valuable perspective to this hobby.