2. misc-audio
  3. 1079624068

Does "Non Compensated" Reviewing Still Exist?

I still subscribe to two of the major "audiophile" publications. To be fair, I would rather not reveal the titles of these publications, so for the sake of reference let's just call one Stereophile and the other The Absolute Sound. I have subscribed to both (and other) publications, on and off, for over 20 years. I have also seen a few other publications bite the dust in the past 20 years. I don't really have any specific interest in the equipment reviews but they used to be a great reference source. Although, I find that the music reviews and new music release information is pretty thorough and diverse.

I just received the newest "XXXXXXXXXXX" publication including the "500 Great Sounding Audio Products". It's actually the "Recommended Components" issue. I decided to thumb through the articles containing said components and read the "final conclusions" to some of these reviews.

Below, I have provided some "conclusion" excerpts from the "reviewed" components of some past issues also.

This "review" excerpt was on a turntable:

"I'm not about to tell you to hock the mink and dump the Mercedes. It only makes sense if you listen extensively to analog LP and have a large vinyl collection or the patience and desire to build one—which today will take no little effort. If you do take the plunge, it will likely be your final investment (periodic cartridge replacements excepted) in analog front-end hardware. The sonic benefits are, in this reviewer's opinion, genuine. But to seek them out must be, inevitably, a carefully considered, individual decision."

Here's another "review" excerpt on a CD player:

"I've heard CD players that had better rhythm and pacing, more midrange liquidity and transparency, greater depth of field, and finer resolution. But I can't recall hearing a more musically involving, fulsomely detailed, three-dimensional presentation from any other CD player at such a modest price as the XXXXXXXXXX."

Or another excerpt on a preamp:

"The "XXXX" is a success after all, but a qualified one: It can play music brilliantly well, and it can be a very good value. Having spent more time with this pretty little thing than I usually do with a review sample, I feel unusually comfortable in recommending it—but now, all the more, I look forward to the day when the clever people at "XXXX" turn their attention to the comparatively cheap and electrically messy world that most music-lovers inhabit."

After reading these compelling conclusions, I have to wonder why I actually read the article in the first place. I also have to wonder what the hell they are actually saying with all of their wishy-washy, totally vague, substance lacking, non-committal crap.

Does real, non-biased, non-compensatory reviewing exist any longer? Is there anyone out there who still does a review in the manner in which these aforementioned publications USED to review? 20 years ago? When these guys didn't like something, they TOLD you they didn't like it, and generally substantiated their reasoning behind their opinions. Likewise, if they actually enjoyed a component. They would be more than willing to recommend a listen OR a purchase.

Now? They don't say anything! I find, by the time you get done reading these reviews, you have no more information from listening evaluation than when you started. I take ANY review with a grain of salt. Electronic components only sound "right" to that particular user, in a particular environment, with a particular synergy, with particular corresponding components. But, it would be nice to have some sort of FAIRLY accurate reference.

Here is MY conclusion to some of these conclusions:

"The "XXXXXXX" is one of the best sounding components of it's type. It will compete with any other component in the same price range, if you actually like the sound of the other components in this price range. When listening to classical music, the orchestra REALLY stood out. Rock music reproduced with this unit was VERY dynamic and loud. Jazz and Blues had exhibited a wonderful "Toe Tapping" quality.

If you are in the market for a component like this one, you really won't do better, unless you consider purchasing a better sounding unit for more money. It IS lacking the dynamics, frequency extension, quiet operation, and build quality of better sounding units, but other than that, it's right there with the best of them in it's class, if of course, you like it's class".

Is this an over generalization, or is this a fairly accurate evaluation? Do others feel the same? Are there review sources that actually COMMIT to their opinions devoid of their commitments to advertising revenues?

Has this become a thing of the past?

buscis2
electric_monk
38 posts
 
As far as reviewing goes I wish the audio mags took the same tack as my two favorite computer mags. PC Gamer and Maximum PC (the same company produces both) are very informative in the review process. They have no problem rating games poorly (Terminator 3 just received a 23% rating) regardless of the company that puts it out.

They also have a column called the "Dog House" where users write in to complain about poor treatment by and shoddy products from manufacturers, either current of defunct. They clear up a lot of confusion for the readers by cutting to the chase and telling you what you want to know, not what the advertisers want you to be told.

One really good idea is a small bio column listing the current games and products that the reviewers are hooked on at the time giving you some insight into what type of games float a particular reviewer's boat (whether it be Sims, First Person Shooter, Strategy, etc.). Maybe we will get lucky and a mag like this will come along for the audiophile commmunity.
sean
6,231 posts
 
Electric Monk: I don't read Maximum PC but my business partner does. From what he tells me, it is a magazine that i would love... IF i was a "puter geek". It sounds like you have the same impression of that mag that he does i.e. head and shoulder's above the rest and able to do so while still retaining their integrity. Where are the audio rags like this??? Sean
>
themadmilkman
182 posts
 
I would love to have a current reference system and music listened to sidebar for every reviewer. It would make understanding their 'reviews' a lot more helpful.
trelja
3,226 posts
 
Very good discourse in this thread!

I have laid back, as most of my views have been made clear in another interesting thread a couple of weeks ago.

Spencer you raise some very good points. I believe the answer for dealing with issues, in terms of shills lurking within us, is one having to prove themselves over time here.

Often, a person will come in all praise and bluster and he has never posted before. This has happened many times, the most easily remembered was the guy who began touting a modded $200 power amp, saying he had owned just about everything over the past 20 - 25 years, and this product was the best he has encountered. I jumped on him immediately, but he issued more posts where he stated his position, that he was not a shill, and that he apologized for offending anyone. However, within a few days, it turned out he was the distributor of the product, but somehow "forgot" to disclose that to all of us.

Yes, with our busy schedules these days, I can see how that happens all the time - "Yes, I own the speaker company, but somehow I forgot to mention it in all of the excitement..."

Again, for me, the thing is long term performance here. I think that like most things in life, you can only get to know a person over the long term. How they conduct themselves always is the final word in truth. It is pretty easy to see if someone is honest. Objectivity is not the most important thing, as this is a subjective field. But, fairness should be the rule.

As we have met in person, I think we both have confidence that each of us is passionate and true to the hobby. That is basically all I look for in a person, be they member, salesperson, distributor, or manufacturer. All are welcome and add to the diversity and experience of this site, in my opinion.
cdc
1,929 posts
 
I've concluded audio is impossible to figure out. Better, worse, or just different, who knows? Heck, many times the differences amount to not much more than a feeling or perception. Getting real, defineable improvements require *large* increases in money spent, for the most part. Typically a 3X increase in cost by my estimation.
I appreciate being able to post less than positive comments on components and have never been deleted. So I don't know about "big brother".
I think most people here post exactly what they think with no financial gain in mind and even in such an "open forum" look at the varied perceptions of good vs. bad. No way a stereo mag can define what everybody will or won't like. Even if a reviewer says exactly what they think.
I'm not defending intentional deceit, just saying that you can't automatically say any component is good or bad.
There appears to be no such thing as right or wrong in audio. Only personal taste. Imagine how confusing regular life would be if we followed the same tao. Red lights mean stop .... unless you're late for work or it's your birthday. Speeding is illegal unless you're going to the beach. And on and on. Without rules and laws, society would fall apart. The audio world is one of anarchy it seems.
Unfortunately, however correct subjective reviewing is, I think it has thrown the audio world into the lunatic fringe (of which I am a member BTW) of consumer goods; Art Dudley giving a helping hand as of late, and resigned audio to an increasingly smaller sector of personal consumption.
More to discover