Equipment reviews, are they credible?


Maybe I'm just thinking outloud but; do all these new equipment reviews have any value? If someone you do not know reviews a piece of gear for which he has spent a significant amount of money can his opinion be trusted. I'm not suggesting the person is lying but I think people have to justify (at least in their own minds) the money they spent.
Then there is the issue not knowing the person doing the review. We don't know their personal preferences or their perspectives. As I read these forums I see there are some names that continue to pop up that give good advice, there are some whose advice is not as good, and some people who are idiots.
How do you know which of the above categories the reviewer of the piece of equipment comes from?
With money having been invested and credibility in question, who can we trust?
128x128nrchy
Opinions are like....uhm, you know....

I have less of a problem with peoples' biases, or even their agendas, then I do with the poor quality of effort and time taken which is being displayed in 90% of these so-called "reviews". A heck of a lot of the responses are more informative and thoughtful than the "reviews"! I at this point frankly think that there is a higher percentage of worthwhile user reviews to be found on Audioreview.com, which is very disappointing to realize.

I believe the easiest way around this situation is for Audiogon to institute a "peer-review" system for the "reviews" themselves. Each review should have, right on the page with it, a box that permits the readers to vote on two catagories:

1) The quality of the review from a standpoint of thoroughness, informativeness, thoughtfulness, how well-written, and how enjoyable it was to read.

2) To what degree they either agreed or disagreed with the writer's findings and opinions.

Both catagories could be represented on a 5-point scale, and the site would automatically compute a running tabulation of the average reactions of Audiogon members to any review. The average result for both catagories could be shown by a pair of decimal numbers between 1 and 5 that would be displayed in the title line of the review, helping browsing A-Gon members to search out quality work, and avoid the dogs.

But more importantly than that last benefit, the review-grading system would have the immediate effect of greatly encouraging review writers to take their time and do good work in the first place, so that it would preemptively weed out all the worthless one-paragraph, unsupported quickie opinion-mongering jobs that are badly written and painful to read (and in my opinion, basically somewhat disrespectful by the "reviewer" of the members such a "review" seeks to be read by).

Without something along these lines being implemented, it's already clear to me that this whole feature is fast turning into mostly a waste of time, and something that will simply begin clogging up the site. To facilitate better reviewing efforts being successfully attempted and completed, however, there are also two things that Audiogon needs to do about the way reviews can be written and posted on the site (I have not yet written a "review" under the new catagory as such, so if I'm about to mention features already in place, please forgive my ignorance):

1) The site needs to be constructed so that a review writer can draft their article over more than one session if need be. The writer must be able to save the current draft of their article on the site, and be able to return to it later to continue writing and editing, submitting the finished work for posting on the forum only when they are satisfied that it is ready. This feature should not be limited in number of sessions or days that it can be used.

2) The writer must further be able to add footnotes or corrections to the body of the original article once it has been completed and already posted as the thread-head, for the life of the review in the archives. These additions should be automatically dated just like a member response below would be, but will have the 'privilege of place' of being located with the original article, for the reviewer to add any pertinent addendums, references, links, corrections, or follow-ups to the review. Reviewer replies to member responses should still be located below with the all the responses, however.

P.S. - Alternatively, we could just send all of our equipment to Clueless for him to review and be done with it. ;-)
The best indicator of credibility is the quality of the review itself.

I think a reader bears the responsibility of considering and working through for him or herself the questions that you've raised. It's no different than reading someone's advice in a thread; you know how to distinguish good, thoughtful advice from the bad.

If you think that people need to be "protected" from bad reviews, then I think this is hopeless. Set up a voting system or whatever, but (1) it's no more credible than the review itself, just adds another layer of opinion on top of opinion, and (2) readers will still filter the data through rose colored glasses anyway.
I'm not suggesting that "reviews" be discontinued. I think they can be of real value. Which is why I began with the confession that I was thinking out loud. It might be a good idea to have them in a seperate catagory instead of where they are now.
Establishing credibility is one of the main issues. The other is establishing a format or something like that to avoid the "Ah reeeally liiiiiked dat new CD ting. It sounds puuurty!"
It seems like too many of the single paragraph reviews don't understand what others may be seeking in their review.
There are people (like Sean or Viridian or Zaikesman, unsound, and obviously clueless) whose comments I enjoy reading. They are generally insightful, or at least funny, which is often more important. The point is once I know someone to a degree their threads or responses have value, people like bishopwill have none.
Maybe the whole thing is getting used to the new item, but it sems like there must be a way to improve the reviews.
For example, I saw a review of my amp a couple of days ago. I am very happy with my amp but the reviewer compared it to an amp I know to be vastly superior and said it was just as good. Again I like my amp, but this isn't a point of opinions, the other amp is far and away better. That is just irresponsible. Maybe this one review is the root for my thread but I've seen other poor quality reviews of equipment I own. The reviews do no one any good.
ARRRRGH, clueless, help me!!!!!!!!!!!!!!
I think personally the reviews are there to encourage Audio sales which is what Audiogon is about.
There is a lot of chat on these forums about abstracts,music,art,hedgehogs,tweaks,DIY whatever and although there is no hostility from the powers that be about that,I think they realise that they would like to see the forums relate more to people spending money on audio equipment.
Hence the flood of reviews which of course are valid on whatever level you place reviews on,some will need more info as to how they were carried out.
For me there has been too many..too quickly...I think reviews are incredibly powerful from whatever source....