Some more good points raised in a thread that's threatening to go off the rails.
Without standardized test methods, test equipment, and multiple people doing the same testing (to minimize bias and error), meaningful comparisons between equipment are difficult to achieve.
Apparently Amir's Klippel diagnostics system is amongst the most advanced in the world.
Many of the standard tests seen on ASR are now being seen on other sites too.
Marketing people love to claim cherry-picked specifications to try to get an edge for sales purposes.
Business is often a cut throat dog eat dog world where the slightest edge can mean the difference between survival and death.
We rarely get to hear some of the heartbreak stories of what happens behind the scenes.
However there is one infamous case that actually spilled over into public consciousness - the notorious Linn v Ariston legal battle.
I'd like to see key reviewer get together and agree on how they are going to collaboratively test audio components - but that is not likely to happen.
No, it's not. Reviewing is also a dog eat dog world. There's only room for so many.
Especially not since most of them are merely peddlers of the following point you raise.
Then there is the subjective measurement/opinion ......
OK, mostly only the purely subjective side.
And this is where ASR and their like come in.