Reviewing the Reviewers


Check out http://www.high-endaudio.com/index_ac.html and follow go to the "Audio Critique" page, and then to "Reviewing the Reviewers" page.

This site is run by a man named Arthur Salvatore. He has written much about all aspects of audio on his site...his recommended components, his recommended recordings, his store, etc. He writes like a lawyer, but it seems like he actually has integrity...he must not be a lawyer. :-) Seriously...anyone interested in a point by point analysis of modern audio reviews should check out this site. He's analyzed many reviews and developed his own list of "rules" that most reviews tend to follow (and he's dead-on)...usually because the writer doesn't want to say anything negative about any particular sponsor's (or buddy's) product.

He received an angry letter from Michael Fremer. The letter and his analysis are included on the site. It makes for a long read, but it can be fascinating. Besides...it's information than every audio joe (or jane) should be aware of when they read any review...especially when they're planning on pruchasing a product highlighted by a particular review.

If you want to see textbook examples of his "rules" put into practice, just check out any Soundstage review written by Marc Mickelson.

Enjoy...
phild
Touché Ka, I humbly must bow to your insight. It was probably the halfconscious reminiscence of my old anger, when I saw the figures I admired, first sway and then fail, which made me now so impatient....and unjust. Apologies to anyone offended.
Fremer's response to Salvatore illustrates how backward (reactionary) Fremer is when it comes to exploiting his own social position. His readiness to form judgements and protect his own interests is, as in all people concerned with status, far prompter toward those beneath them (and one of the purposes of his response is to situate Salvatore below him) than toward those higher up. It must be a good deal writing for Stereophile (a better deal than Salvatore has in writing his web page or any of us have writing our posts at audiogon and our gratis reviews at other audio sites). What strikes me is that Fremer for the most part is unable to give an account of the social function of his writing. This is paralleled by the fact that Stereophile contributors in general are not able to publicly reflect to any significant effect on their function in their dealings with manufacturers (except for the manufacturer's reply column). There are undoubtedly somewhere in the world reviewers who take a naive view of their own activities and who genuinely believe that their only moral task is to distinguish between good components and bad (some of the names of these reviewers were already mentioned in this thread), and those that believe that their only commercial task is to distinguish components that will sell from those that will not. In general, however, it is probably the business people at Stereophile that have a clearer idea of the circles to whom Stereophile is selling than the individual Stereophile contributor has of the audience for whom they write. Fremer, or any other Stereophile contributor is really in no position to control all of Stereophile. And who else should do it? Not the reading public; the activities of Stereophile fall outside all of our fields of vision (we may be interested in some of the same components as them, but we work outside Stereophile). This leaves the audio retailers and manufacturers as a court of appeal. But it is almost superfluous to mention how problematic, irresponsible and secret retailer and manufacturer control of the audio press must be.
If one wanted to fully critique the audio press, one would need a statistical survey of the capital at work in the audio publishing world. What is the source of these capital sums? Specifically, how much capital has migrated into a publisher from a given manufacturer in advertising fees and "corporate hospitality" (dinners, gifts, free reviewer samples, etc.)? On the other hand, what does an audio publication supply to the audio market for this manufacturer? It would be a short step from there to combine these questions and investigate whether, when capital flows into a publisher, it is directed at specific customer strata and trends that correspond to, say, SACD as opposed to DVD, or certain manufacturers as opposed to other ones, etc. It would be interesting also to see the sales figures in different markets for the main products advertised by or positively reviewed by a publisher. Of greatest interest would be information about the rating of a component and the advertising charges for it in the same magazine (Salvatore has repeatedly pointed to collusion on this level); likewise a picture of the relation between commercial success (sales figures) and literary succcess (critical reception in the press).
Of course, there are valuable components that fail to sell, and that a good publisher well nevertheless wish to sell not only as a matter of honor. But of course a common--and cynical--view of publishing is to see it as selling worthless components that succeed in selling only with its help. Another way to see audio publishing is as a combined operation, consisting of organized patronage and a lottery, in which every new component is a number and the reading public acts as banker. From the player's (in other words, the publisher's) winnings, a part is to be used to bet on numbers (components) that look splendid and significant but that scarcely figure into the gambling of the reading public. How much the player (the publisher) can bet on these numbers of course depends on their winnings on other more successful numbers (components). Of course, a publisher has to have a close relationship with specific writers--it does not need to follow a particular line--in order to maintain contact with a reading public. Obvious though it is, it is striking that in America, which possesses a number of clearly defined audio publications--Stereophile, the Absolute Sound, Ultimate Audio, etc.--very few attempts have been made (excepting Salvatore's and a few others) to undertake a systematic critique of these institutions. Yet this would be the only way to measure the abyss that separates big publications from smaller underground publications and those internet webzines that appear and disappear by the dozen every year, only to be replaced by similar smaller publications that open up in their wake. A systematic critique would also be a way to measure the gap that divides some of these big magazines from their disillusioned readers. It may lend additional weight to this already lengthy, abstract and unoriginal reflection if audio publishers came to see that the leaders among them will benefit more in terms of honor and profit from a sound criticism of their activities than from a socially reactionary response to one of their reviewer's (here: Fremer's response to Salvatore). Only experiece will enable us to discover the benefits of such a critique.
Slawney, would you really say that Salvatore's critique of "these institutions" you mention is a "systematic" one, as you call it ? (Unless of course by systematic you mean a critique of the alleged "systems" behind those institutions and not the critique itself being systematic in its methodology and purpose) Besides that, I find your thoughts interesting and indeed an inquiry along the lines you draw out for us, could show us publishing policy, but hardly, I venture to say, something about the spirit and the integrity or lack thereof, of the individual journalist, who sometimes may be lead by a large rope and sometimes not.
Detlof, the analysis I am suggesting, I believe, is a reliable method of making use of audio magazines to inquire into the spiritual (intellectual) currents of an institution (in this case, a long-established audio magazine), not of the intergrity of an individual journalist, as you say, except to the extent that that journalist embodies the systematic interests and principles of the institution for which he works. Such journalists are not unknown. I think we all know a few. In an age (and a country) in which both economic and intellectual production has been so thoroughly rationalized (as in America), it is the norm that audio magazines like Stereophile and the Absolute Sound work fairly systematically in comparison to underground publications. One sign of this is the way a publisher approaches individual reviewers with specific projects and sometimes very specific plans. Readers are making a great mistake when they see reviewers as mere gatekeepers or yes/no sayers, instead of as experts in a publishing policy who are intelligent enough to follow through on this policy rather systematically by drawing up plans (with or without their editors) for their articles before writing them. The audio press reading public is also wrong (as you say in your admirable post above) to set their idealism against a publisher's materialism, instead of treating their own ideas in such a way that the publisher will be tied to them for the sake of their material interests. What if a large number of audio enthusiasts started to think otherwise about audio technology than Stereophile and the Absolute Sound? I think that these magazines would be desperate to find out how their readers' ideas have changed to reestablish their customer base and market share. As far as Salvatore's critique is concerned, it is systematic to the extent that he outlines some of the principles and policies that reviewers obey when they write and he has even drawn up a chart showing the increasing number of advertisements in Stereophile and the increasing number of components on its "Recommended Components" list. This is an important aspect of a systematic critique which would also have to make use of sociological and financial data that Salvatore does not possess in order to further lay bare publishing policies. Such a critique would probably expose the conception of the audio magazine as an organized patronage/lottery system that I mention above as a common annd erroneous conception of publishing. Who should do this critique? It would probably be a perilous and thankless task. Look at some of the inflammatory reactions to Salvatore's website (not only the responses from journalists, but also from audiogon members). Perhaps it was even wrong of me in this thread to point to the political theological dimension of Salvatore's project (his similarity to Martin Luther) since such comparisons are easily parodied to his disadvantage. I still feel it would be illuminating to call for case-by-case opinions from audiogon members about Salvatore's own "Recommended Components" and "Supreme LP Recordings" and his own sense of fair play (the dispute between him and Fremer lies in Salvatore's site's negative assessment of the Rockport turntable and the Stereophile recommendation of it as an A+ analog component of the year, to a large extent) since Salvatore cannot be approached completely only on the basis of his 'Reviewing the Reviewers' page alone. Some audiogon members have already given a few case-by-case opinions about Salvatore's other pages (one member already indicated that Salvatore's recommendation of a Parasound CD player shows his analog bias, and so on). I would like to see more case-by-case opinions of Salvatore rather than general put downs. Personally, whenever I find I disagree with Salvatore on some component or LP recording, I cannot help but feel that he should nevertheless excercise more of a decisive influence on readers (especially young readers) than some of the big audio magazines.
Slawney, thankyou for your thoughtful response to my query. To my mind at least it should be difficult to refute the points you make in your brilliant analysis. The methodology you suggest, is, as you say, difficult to apply in practical terms, but it points a way to help us hone our critical minds, helps us to question rationally and "systematically". I very much agree with the conclusions you draw in both your posts and wish to thank you for the time and effort you took to share your thoughts with us! Regards,