Equipment reviews, are they credible?


Maybe I'm just thinking outloud but; do all these new equipment reviews have any value? If someone you do not know reviews a piece of gear for which he has spent a significant amount of money can his opinion be trusted. I'm not suggesting the person is lying but I think people have to justify (at least in their own minds) the money they spent.
Then there is the issue not knowing the person doing the review. We don't know their personal preferences or their perspectives. As I read these forums I see there are some names that continue to pop up that give good advice, there are some whose advice is not as good, and some people who are idiots.
How do you know which of the above categories the reviewer of the piece of equipment comes from?
With money having been invested and credibility in question, who can we trust?
128x128nrchy
I agree, a listing of reviews would be most helpful. In fact, if you wanted to search out a particular piece, how would you go about it? I was just looking at some of the reviews & when I tried to do a search for them I came up empty.
Zaikesman, I also like audioreview's format for quick scanning through to find the good ones.

As for a rating system, I've seen them work well on some bulletin boards for guaging which threads are worth a look. I've noticed, however, that on Amazon.com high ratings often go to very short but favorable revews. I suspect that it's because people who like the reviewed item want to support to the good reviews, just as people like to write positive reviews to taut their gear. On rollingstone.com, you'll often see an album get three (out of five) stars in the editorial review but five stars in the readers' rating (anyone with a modem connection can rate the album). So it rolls into more of the problem of self-justification that Nrchy pointed to.

I do like your idea about creating incentives for people to write better reviews in the first place. My suggestion would be for audiogon to add questions to the review form like "what equipment did you compare this against?" "what other similar equipment have you owned?" "how long have you owned the piece?" "Name the three greatest weaknesses of this piece?" etc.

These questions would encourage writers to include more information that would help us understand where they are coming from. They could also get the reviewer to confront common questions that a reader would ask as he or she writes. Most importantly, I think it will allow the reader to get a sense of the reviewer. Even if the reviewer enters "none" for weaknesses, you know something's rotten. More disclosure and information means more context for the reader to understand the review. Let the reader be the judge, but it helps the reader to have more information about the reviewer.

Going even further, I would say, don't let reviews be posted unless the author fills in all the blanks. It forces the writer to take some time with the review and discourages hastily dashed, "This is the best CD player ever. The end."

Of course, there will still be reviewers who'll just go enter "N/A" for every blank and write little more than "This is the best CD player ever. The end." And it doesn't stop people who have an agenda from posting. But I think it will be more obvious among the many reviews which writers have taken their time to craft the review an which ones havent'. In other words, we may not cut down the fluff, but it'll be more clear to the reader what is fluff.
Yeah, I think we're on the same page about this stuff, Turnaround. What you pointed out concerning a ratings system's being potentially biased towards favorable reviews of gear anyone rating the review personally happens to like, is why I proposed a two-pronged ratings approach as detailed above. One rating for the quality of the article, one for agreement or disagreement with the take of the reviewer. My idea is that this would tend to keep the raters more objective about article quality. I think your idea of some 'leading questions', as we say in sales, to guide the review writers is also not a bad idea.

P.S. - Nrchy, I'll raise a hand for Bishopwill based on my exchanges with him. You listening, BW? Get in here and defend yourself! :-)
Post removed 
I was away for a while so missed the start of this aspect of the forum topics. I have read many with interest and found some of them useful. So, I think this is a worthwhile addition to the site. However, I would like to echo comments above regarding problems with their integration into Audiogon. Perhaps a separate section for the review postings--or at least for the archived reviews--would be better than including them with the other forum discussions. My 2 cents.