Example of a piece o’ crap, useless review


I’ve harped on how crappy and useless many “professional” reviews are because they lack rigor and omit critical information.  This one is from TAS that is a main offender of pumping out shallow/unsupported reviews, but most of the Euro mags among others are guilty of this too IME.  One key giveaway that a review is crap is that after reading it you still have little/no real understanding of what the piece under review actually sounds like or if it’s something you’d like to consider further.  I mean, if a review can’t accomplish those basic elements what use is it?  This review is so shallow it reads like it could’ve been written by someone who never even listened to the review sample and just made it up outta thin air.  In addition to failing on this broad level, here are some other major problems with the review:

- There is no info regarding any shortcomings of this “budget” turntable — everything is positive.  Sounds like it was perfect, ehem.

- There are no comparisons to another product in the same general price category or anything else.

- The reviewer doesn’t even share what equipment is in his reference system so we can at least infer what he may have based his impressions on.

In short, in addition to this review being so bad/useless for all the reasons stated it actually reads more like advertisement for the product than an actual unbiased review.  I can think of nothing worse to say about a review, and sadly many reviews out there are similarly awful for the same reasons.  Sorry for the rant, but especially as a former reviewer this piece of garbage pushed all my buttons and really ticked me off.  What say you?

https://www.theabsolutesound.com/articles/sota-quasar-turntable-and-pyxi-phonostage/

soix

Showing 16 responses by soix

If you ever want to link a review as an example of one you like, or admire, or appreciate, then I would like to read it for positive context.

@tvad Here’s a review of the same speaker that is much more rigorous and contains all the elements I mentioned before (review system, comparison, limitations) that the TAS review completely lacks   As a result I find this review much more informative and provides much needed context to get a better idea of the speaker’s overall sound and character not only on an absolute but also on a relative basis.  Not only do I come away with a better idea of the speaker’s sound, I have a much better idea if this is a product I’d be interested in pursuing further that I could not as clearly discern from the other review, and isn’t that really the point of reading a review?  All that said, it should be apparent how much more time and effort it takes to produce a review of this caliber as opposed to just spewing superlatives in a bubble with absolutely no context whatsoever.   Like I said earlier, the TAS review is much easier/faster to produce but is much less useful or effective IMO.  Hope this comes through for you too and that this clarifies things a bit.

https://www.soundstagehifi.com/index.php/equipment-reviews/1859-goldenear-t66-loudspeaker

@tvad Its not about perspective, it’s about a review containing basic critical elements that make it truly informative, thorough, and ultimately more useful.  Pretty much any review will be more effective if it includes a discussion of a product’s limitations or potential shortcomings (all products have them), comparisons to another product, and the equipment in the reviewer’s system used during the review.  This is basic stuff any rigorous review should include and none of which this review does.  I can attach another review but don’t feel it’s necessary as the problems here are just in this review’s multiple deficiencies and omissions that make it basically useless — it’s just a guy waxing poetic about the wonderful sound of a product in a bubble.  It’s a lazy, useless piece of drivel that can be cranked out in a matter of a couple hours because it requires none of the discipline, time, or effort to assess and include these other critical elements in the review.  The benefits to TAS of these “reviews” is they can produce more reviews more quickly while avoiding any accountability or scrutiny because there’s no check and balance on a review’s opinions and assertions.  The ability to generate ad dollars is tangible while the tangible benefits to the reader are minimal.

As a follow-up, here’s another crap review by the same reviewer that I only read out of morbid curiosity as I never bother reading TAS “reviews” (aka product ads) anymore, but at least this is a little more like a review than just a pure product ad (although it’s pretty damn close to one). But still and yet again, in the end I have very little idea of what the speaker actually sounds like, which is about the worst thing that can be said about a review. It is so generic it reads like it could’ve been written without even listening to the speakers at all, and all he does throughout the review is extoll the speaker’s apparent virtues in a bubble and reveals no limitations or qualifications whatsoever so apparently they’re perfect!?!  On top of that he never compares them to anything else or even bothers to disclose what speakers or any other equipment is in his reference system!!! It’s ridiculous and about as rigorous and thorough as your typical crappy youtube video review, but sadly this type of unsubstantiated and basically useless garbage is par for the course at TAS so this dude fits their mold to a “T.”

https://www.theabsolutesound.com/articles/goldenear-t66/

I am sure "their" certain about the difference between "there" and "they’re".  And it's not a matter of grammar.  It's merely about spelling.

I’m not sure of that at all.

Sadly, many here are not even grounded in basic grammar, like the difference between their and there.

Or base and bass, manufacture and manufacturer, Schiit and…

@mschott But it’s not even a review — it’s nothing more than an ad disguised as a “review.”  And as for the readers of this thing not being high-end consumers, how many entry-level buyers is crap like this really gonna attract or maintain as subscribers for TAS?  Then again it’s sadly not all that much more useless than their usual pandering fluff reviews so it’s not totally out of character for this rag — I’ll give you that.

Really, Part Time Audiophile as an example of good reviews?  Their stated policy is to NOT publish a bad review.  The puff pieces I've read on their site goes far beyond hagiography and would make even the most shameless fan boys blush.  No measurements at all.

@phoenixengr Point well taken.  Truth be told I haven’t read PTA reviews in a while but used to like his reviews back when he was on his own, so I probably shouldn’t have included them cause I’m not very familiar with their current reviews/writing staff.  Thanks for the redirect.

The irony with audio reviews is that everyone hears differently.  A piece of audio gear that sounds good to one person may not sound good to another.

@jimmyblues1959 Exactly.  And this is why doing product comparisons in a review is so important.  When a reviewer just shares what he thinks about a product in isolation (as TAS habitually does) we’re only getting his take based on his ears.  But when the product is compared to something else we get a sense of relative differences, which I find adds very important context that can help us as readers form a clearer perspective of the sound of the review product regardless of how the reviewer hears things.  In other words, a comparison acts like a check and balance on the reviewer’s individual opinion and provides for a much more approachable and ultimately more useful review for the reader.  However, if you’ve read a reviewer long enough you get a sense of how he hears so you can compensate somewhat for his biases and still possibly glean some useful information out of the review, but this is still no substitute for doing a legit product comparison IMO.

Reviewers almost never give an actual bad review because they know if they do that, manufacturers will stop lending gear for evaluation.

@roadcykler Actually that was not my experience. Over 17 years I only wrote one negative review, and I was not opposed to writing more if warranted. The thing is, for a product to make it to the level of getting a review among the thousands of products out there it needs to have some positive and usually even some special buzz about it. So almost every component that gets reviewed has been well vetted by many users and others so bad sounding equipment just never tends to even get reviewed. In short, the system self selects very good sounding gear right from the start. Also, the major manufacturers know what they’re doing, and it’s almost non existent that something they’d release to the public sounds bad. So this is really why you rarely read a bad review.

That said, that’s where the “art” of reading between the lines in reviews becomes important. Unlike the crappy “review” I mentioned in this thread, most good reviews will include a paragraph or two near the end just before the conclusion (that’s where I always put it) where a reviewer will elaborate on any shortcomings/limitations or qualities that he may have alluded to during the review that seem a bit off or things the reader may want to hone in on while listening or comparing to other equipment. THIS IS CRITICAL INFO SO READ IT CAREFULLY! So, while the product overall may be very good, these would be the potential “negatives” that the reviewer feels are important to highlight but they’re not nearly enough to trash the product and throw the baby out with the bath water. This again is why product comparisons are so important because these potentially aberrant qualities can be analyzed on a relative basis versus another known product and provide a very useful perspective on any potential issues. Also, reviewers aren’t all-knowing oracles and what we may think is a shortcoming for our system/tastes may well not be the case for many other potential customers, so better to just point out what we heard objectively and let the reader decide if that’s something they’d still like to explore further. Last, most audio manufacturers are not rich and do what they do for the love of it and many others might be relatively new, and a bad review could literally sink a company. Now, if the product outright sucks so be it although it’s highly unlikely that product would’ve made it to review anyway as mentioned above, but if a product isn’t perfect yet shows some promise as a reviewer you’ve gotta weigh the extent of the shortcomings and if they’re bad enough to potentially put the company out of business. So there are many things to consider as a reviewer. I wasn’t on the business end so can’t speak to manufacturers threatening to not send any more gear if they get a bad review, but I never heard of anything like that although it may happen. Anyway, I hope this sheds a little light on why there are so few negative reviews. It’s really not a conspiracy in my experience.

Given true long format reviews typically take six months to do. It is really not that surprising that each issue could only contain a few of these. Do the math.

@ghdprentice I can’t speak for TAS, nor would I care to, but at Soundstage we had three months to complete a review. I used to use the first month for break in and initial impressions and the next two months for critical listening evaluation and writing up the review, and that was sufficient time IME.

Out of curiosity, of the full format reviews how many provided a comparison to a competitive product? I’m gonna guess none and will be shocked if it’s higher than that cause that’s just not how they roll. Much quicker/easier that way although much less informative and useful IMHO.

@jhnnrrs @aolmrd1241 I can’t speak directly about the other sites, but having written reviews for Soundstage for 17 years I can tell you that all they strive for are thorough and honest reviews, and BTW they have a site dedicated specifically to “budget” gear (Soundstage Access) so they don’t only review “uber high-end” equipment. Over all those years I was never told to write anything other than what I heard, and all of what I wrote always made it to publication without any alterations (other than some light editing) whatsoever. Furthermore, to ensure the reviews were as useful/rigorous as possible all reviews had to contain a relevant comparison section, and if you didn’t have a comparable product on hand or couldn’t get something you didn’t get the review, period, and all the equipment in the reference system used during the review was always fully disclosed at the end of the review. All this put together makes for what I call rigorous and credible reviews that are likely trustworthy and well worth reading and using to help decide which components are worth pursuing further.

After writing and reading reviews for many years it gets pretty easy to tell which reviews are more objective, thorough, and honest and which are more useless, superficial fluff so just dismissing reviews out of hand because the site uses ads will block you from a lot of truly useful and helpful information that is out there. Some basic tells for me is if the reviewer compares the review sample to other product(s) to give some critical perspective on the sound, the reviewer shares any shortcomings/limitations and/or unique sound signatures the product has (they all have them), and the reference system is fully disclosed. There are some good reviews that may miss some of these, but if any of those elements are missing I consider it a red flag and read with a jaded eye. Last, you can kinda tell just by the way the review is written whether it’s by someone who really did the work as opposed to a guy who just throws out a bunch of generic platitudes. Sorry to drone on, but that’s my approach to it and I’d encourage you to seek out those good sites/reviewers rather than throwing out the whole bunch for using advertising or because of some bad apples out there. There is some extremely helpful and informative info out there if you have the time/patience to uncover the gems. Again, FWIW.

Most all reviews are now Infomercials.

@yesiam_a_pirate I actually somewhat disagree with this. There are many publications out there where reviewers are passionate about conveying honest and useful information for readers in their rigorous and thorough reviews. Unfortunately there are also many where profit/attracting eyeballs takes precedence over review quality. The key is to identify the more credible sources/reviewers from the hucksters/posers. Here’s a list off the top of my head, and in no particular order, of publications I read and find provide mostly credible and useful reviews…

- Soundstage, 6 Moons, Part Time Audiophile, Positive Feedback, Enjoy the Music, The Audio Beat, Stereophile

FWIW.

Soix, Did you write a letter to TAS complaining about the quality of this and other reviews they publish? 

@lewm Yes.  A while back I wrote to them about these issues but not surprisingly didn’t hear back, and obviously nothing changed.  I’ve also spoken to a couple of their reviewers and they both spouted the same company line that product comparisons aren’t useful because it’s unlikely most readers own the exact component used for the comparison.  This is just an absurd rationale used by them to try to excuse themselves from the considerable amount of added work it takes to do comparisons and the inherent accountability that it brings upon a reviewer — much easier/faster to just wax poetic about what you think a product sounds like in a bubble with no check and balance of a comparison.  One of their reviewers said he’d consider doing more product comparisons in the future, but I’ll believe it when I see it and not holding my breath. 

The type of review you are looking for might be over the head of the majority of people looking to buy a TT at this price range?

@bigtwin Uh, what??? This is a $3000 turntable without a tonearm and cartridge. In what world does a product at this level not deserve a full and thorough review? Further, I don’t care if it’s an entry level Pro-Ject turntable or an AudioQuest Dragonfly, any product deserves a better effort than this piece of shite no matter what the level of the reader. This thing is utterly useless to anyone. @ghdprentice nailed it when he called this more of a description than a review. TAS has no shame and they don’t care, they just want to crank out “reviews” with as little work/time as possible to keep those ad dollars rolling in. Why bother with all those pesky product comparisons or listing the equipment in the reference system? Takes too much time!  Just throw it out there half assed ASAP. Waste.

I totally get how it reads like an ad campaign and not a review but I bet it is a great table. 

@oddiofyl You know, and that’s exactly the point.  I greatly respect the brand and am genuinely intrigued by the design, which made this even more disappointing as the review gives me absolutely no clue as to why I’d want to pursue it further based on its sound characteristics and capabilities.  Absolutely useless and sad. 

I don't even read reviews and have another (higher) level of abhorrence for youtube reviews. 

@carlsbad2  Amen to that.  There are a few decent ones that I’ve seen, but the vast majority are just posers who get off on talking into a camera and garnering eyeballs — depth of knowledge/experience and/or quality/depth of content be damned.