What should be mandatory in every professional published review-


When testing a company's newest amp, preamp, etc, and it is a refinement of a prior product that was on the market, ie, a Mark II, an SE version, a .2 etc, it should be mandatory that the review includes a direct comparison with the immediate predecessor. IMHO, it's not enough to know ion the product is good; it's also important to know if there is a meaningful difference with the immediate predecessor.

I'm  fan of Pass Labs, and I just looked at a review of an XP22 preamp. I find it very disturbing that there was no direct comparison between the XP22 and the XP20. And this lack of direct comparison is ubiquitous in hi-end published reviews, across all brands of gear tested. I don't blame the gear manufacturers, but rather the publications as I view this as an abdication of journalistic integrity.

 

Opinions welcome- 

128x128zavato

"Gear that sounds good"

That is so different amongst listeners that it would help to know what the sonic preferences of the reviewer actually are.

You simply won’t ACTUALLY know the sound of a thing unless you give a component time in your system...If a lot of reviewers say the same thing about something you can make reasonable assumptions

@wolf_garcia And that’s the whole point. I’m not saying it’ll be certain that this will necessarily coincide with your hearing, but it certainly gives you a possible indication of what you might expect to hear or want to audition. Nobody’s saying the reviewer should be the final arbiter of what you should think because that’s ALWAYS up to you and your ears, but if you read consistent impressions by reviewers you can certainly include that in your arsenal as to what you might or might not be interested in. To me, that’s as far as the benefit of reviews should go given all the variables involved, but I hope you can agree that used for the information they can potentially offer within their limits they can still be very useful.

I am probably idealistic, but I would like to know a reviewer’s ties and obligation to any company whose products are they reviewing, along with the publication’s. "Pay to play", payola, freebies, etc have long plagued magazines that review gear, and it calls into question the independence and integrity of reviewers and their publications. For example, some photography and gun magazines and their writers have been notorious about taking freebies from manufacturers, or doing glowing reviews on products and—like a miracle (cough, cough)—a few pages later you see full-page ads bought by those same manufacturers. For that reason, Consumer Reports buys everything they test iirc, so they are not beholden to manufacturers. The magazine business has gotten very tough, and advertising is the lifeblood, but magazines who basically sell glowing reviews in exchange for ads are whores. I don’t know which audio reviewers and publications are the best and worst in this regard (and I am not asking here!), but I have been told who is by trustworthy by people whom I trust.

It’s a matter of who can one trust, and that is enormously important to me. YMMV. I am not talking about subjective opinions, I am talking about opinions which are purchased.

I won’t name names, but a few notable veteran people in the audio industry have named to me reviewers they trust to be straight-shooters, and also those who are renowned for taking gear (either outright or in the form of "longterm" loans, or buying gear at cost) from manufacturers. One longtime retailer literally guffawed when I mentioned a very prominent reviewer who is apparently egregious in accepting gear as a quid pro quo (either that or he is a millionaire and can afford his $1,000,000 reference system/gear, and it’s possible I guess). I have had personal communication with a reviewer who has probably a >$150K (or more) reference system, and who admitted that most of it is very long-term loans from manufacturers. Hell, I can’t even get most dealers to allow an in-home audition without buying the item in exchange for a return policy (in their defense, they may have only on demo model of an item on hand). For that reason, the return policies of Music Direct, Audio Advisor and some other online dealers are great, but they don’t always carry what I am interested in.

If a publication is afraid to publish critical reviews (that doesn’t mean bad, it means honest), then they should say so. They should also disclose any ties to manufacturers or ways in which they are beholden. I have some experience with this working for the LA Times for 20 years. We were not allowed to accept anything of value over $25 from anyone we were doing a story on, which basically limited it to a modest meal. We had reporters who were fired for violating that code of ethics.