The Audio Science Review (ASR) approach to reviewing wines.

@prof 

To quote from my previous post - "the speaker design - box vs planars vs horns vs OB".

You'll have no problem in any gathering of audiophiles finding people who prefer Magnepans or Klipschorns or Linkwitz over box speakers.  These speakers and many others differ in basic method of sound production, on- and off-axis frequency response, radiation patterns, impedance curves...  All of them have their fans.  They all differ quite noticeably in the way they sound.  Any set of measurements that would match well with one of these designs would likely produce poor results with the others.  Based on your argument, knowing Amir's specific measurement criteria should tell us what kind of speaker he prefers (subjectively).  You can't simply average all the speakers together into a Frankenspeaker.  So, has he ever divulged his reasoning for the measurements he makes and how he established their usefulness?

petaluman:

Amir has explained his choice of speaker measurement, the Spinorama, because of its closeness to the measurement in an anechoic chamber. There are explanations giving details of the setup on the ASR site.

He has posted his main system. He has used Revel Salon-2 floorstanders in that system.

I don't often read the site. There seem to be many there who prefer KEF monitors, and a fair number who like powered monitors from Genelec, Neumann and Dutch & Dutch.

And here’s another big problem with their methodology…THEY HAVE GOTTEN THE MEASUREMENTS WRONG. I’ve personally seen it, and frankly , it was embarrassing. If that’s your ONLY acceptable criteria and you screw it up…well what good are ANY of your conclusions and how can you be trusted?

@jonasandezekiel 

Would you care to elaborate on what it is you have seen?

I think the wine tasting analogy is a pretty good one. That said, how about the Absolute Sound Magazine approach which is essentially the opposite?
 

Steven Stone’s & a few others reviews of lesser expensive stuff are often very useful & compare the item being reviewed to other similar products which can offer a practical & helpful information to better understand the pro’s & cons of the equipment & how they might compare to what you own or are considering. 
 

Most of the remainder of their reviews of many really amazing products are simply glorified, extended advertisements & offer very little objective evaluation. Take for example their recent review of the Thiele Zero Tracking Error Turntable. It’s probably a very fine sounding turntable but it’s never compared directly or even from memory to anything else in its price range. Additionally & maybe more importantly, it’s never discussed or even mentioned what would be the potential benefits of zero tracking error & or they were heard in listening to it. That would have been useful & informative. 

At least Stereophile for the most part objectively tests stuff. It could be very useful to know if an amp, for example & generally a tubed one, puts out its rated power w/ less than a few % distortion if you’re considering buying it & sufficient power for your speakers is a question. Of course, the true test is listening to something in your system but that’s not always possible or practical. 
 

Objective & subjective reviews & information are both useful & have their place.