What is the standard for judging a systems sound?


It is often said in these threads that this hobby is all about the music. That live music is the only meaningful standard for comparison when determining the quality of a stereo system. While these words sound good, are they really true?

A violin should sound like a violin, a flute should sound like a flute, and a guitar should sound like a guitar. Many purists will immediately say that amplified/electronic music cannot be used as a standard since a listener can never really know what the intention of the musician was when he/she recorded it, and what that sound should be.

Even something as simple as an electric guitar has multiple settings from which to choose. Electronic keyboards have hundreds of possible voices, so how does the poor audiophile know how the tone was supposed to sound?

These are valid concerns. Back to the purists!
“That’s why only unamplified classical music can be used as a standard!!!” On face value that looks like an acceptable statement. Consider some facts though. In my immediate family we a have several musicians who play a few different instruments. We have an electric piano (due to a distinct lack of room for a baby grand), acoustic guitar, Fender Stratocaster electric guitar, a nickel plated closed hole flute, a silver plated open hole flute, a viola, and a cello.

I have a fairly good idea how each of these instruments sound. One comment I must make immediately is that they sound a little different in different rooms. Another comment, which demands attention: when I bought my first flute I knew nothing about flutes. I began fooling around with it and enjoyed the sound. I liked it so much a bought a better, as mentioned silver open-hole flute. This flute sounded much better than the first flute. The tone was richer (the only words I can think of to describe the difference).

The reason for that background information is to show that the same instruments in different room’s sound different, AND different models of the same instrument have a much different sound!

If we audiophiles are using live unamplified music as a standard there are still several important issues, which must be addressed. How do we really know what we are hearing? What instrument is the musician playing? Was that a Gemeinhardt or Armstrong Flute. What are the sonic characteristics of the specific instrument. Stradivarius violins sound different than other violins, if they didn’t people would not be willing to pursue them so aggressively. Better instruments (theoretically anyway) sound better than lesser instruments. The point here is that different versions of the same instrument sound different.

I have seen the same music reproduced in different settings. I have heard string quartets play in a garden in Vienna. I have heard the Pipe Organ in Stephan’s Dom. I have heard Rock and Roll in arenas and Performing Arts Centers. I have heard jazz played in small one room clubs, not to mention the above listed instruments played in the house.

Each one of these venues sounds different from the other.

When I am listening to a selection of music at home, how do I know how it is supposed to sound? None of the LPs sounds like any of the particular places I have heard live music, while none of those places sounded like any other either.

There is no standard by which to judge the quality of live music since no two venues sound alike. If everyone were to go to the Royal Opera House in Covent Garden and hear Tchaikovsky’s Symphony No. 6 would everyone hear the same thing? Even if they did, and that one concert became the standard by which all other recorded music was judged, would that be translatable to allow the judging of all other music?

I have never heard a cello reproduced as well as my sons playing in the living room. I have never heard better flute players sound better than my own terrible playing at home.

So what do we audiophiles really use as the standard by which recorded music can be judged?
128x128nrchy
Zaikesman, I'm not sure how anyone would ascertain which system is superior, but I have laid out a workable method for determining whether your system accurately reproduces what is on any disc. Namely, go listen to the music in the studio where it was mastered. Regardless of what the live performance was, it was only at the final mastering phase where the engineers and the artists determined what they actually wanted the disc to sound like. Compare that playback to what your system/room sounds like and you will have a fair standard for performance accuracy.
Oh, I agree Onhwy61, and there have been times that I've recorded or produced in the studio where what I heard when I got home made me sick by comparison. Unfortunately though, unless you're able to afford an unquestionably top-flight studio and engineering, this may not mean as much as you imply. Reason being, if the studio has deficiencies or anomolies that will always skew the final product - and probably the majority of modest-cost studios do - then the deck is stacked mo matter how good your home reference system might be, and you can't use your suggested method to make judgements about its fidelity. Your position assumes that the engineer will have a system at his diposal which enables him to make 'correct' judgements (another subjective area), and this just isn't often the case for most amateur musicians. The result (that the master sounds different, and better, in the studio than it does at home) is not necessarily an indictment of the home system in such cases, and is usually to its credit.
You're right, not all studios are created equal and some studios are without question better than others. But I'm referring to mastering studios and the reality is that the majority of commercial releases are mastered at a small number of studios (Gateway, Georgetown, Capitol, Sterling, etc.). These studios feature professionally designed rooms with top flight equipment. Any number of Audiogon regulars have equipment that equals or exceeds that found at these studios, but how many have custom designed, tuned and built acoustic environments? All I'm suggesting is that listening in the mastering studios will provide a known point of references for judging the performance of your home system. It would be a tough test, but one that some audiophile systems here on Audiogon would pass.

BTW, I actually haven't tried what I'm suggesting, but based upon my experiences I know I like my sound a little less "in your face", more spacious and with slightly hyped low bass than compared to what's actually on the disc.
Onhwy61, what you propose is a very interesting test. I think this would go a long way in judging the difference between the master tape and our choice of playback medium.

The question remains though, how much difference is there between the the original event and the master tape? I am asking, since I have no way of knowing what it is, I have never been in the position to experience this.

Does a flute sound like the flute played in a concert hall, does the cello not only sound like a bow dragged across strings or is all of the resonance there too? There is soo (That spelling is intentional, similar to the use of the word 'too' in conversation) much information available to the ears when an instrument is played that is never reproduced on an LP or CD. I'm not sure where the fault lies, but that is not the issue for this question.

I still want to know if it is possible to have an ultimate standard with which to judge the quality of playback of my, or any other stereo system! Right now, I don't think we do although your test Onhwy61 is a better standard than has been offered before.
Nrchy: The way to know the difference between the mastertape and the original event would be to listen at the mic position during the original event - except that you can never know exactly what was captured on the mastertape without putting it through some kind of playback system that will distort it. And that includes the original studio's monitoring system, which may be no better than a good home system at representing the mastertape signal fed into it...

You would, however, gain insight into what the mastertape engineers and producers heard to work with.