Some thoughts on ASR and the reviews


I’ve briefly taken a look at some online reviews for budget Tekton speakers from ASR and Youtube. Both are based on Klippel quasi-anechoic measurements to achieve "in-room" simulations.

As an amateur speaker designer, and lover of graphs and data I have some thoughts. I mostly hope this helps the entire A’gon community get a little more perspective into how a speaker builder would think about the data.

Of course, I’ve only skimmed the data I’ve seen, I’m no expert, and have no eyes or ears on actual Tekton speakers. Please take this as purely an academic exercise based on limited and incomplete knowledge.

1. Speaker pricing.

One ASR review spends an amazing amount of time and effort analyzing the ~$800 US Tekton M-Lore. That price compares very favorably with a full Seas A26 kit from Madisound, around $1,700. I mean, not sure these inexpensive speakers deserve quite the nit-picking done here.

2. Measuring mid-woofers is hard.

The standard practice for analyzing speakers is called "quasi-anechoic." That is, we pretend to do so in a room free of reflections or boundaries. You do this with very close measurements (within 1/2") of the components, blended together. There are a couple of ways this can be incomplete though.

a - Midwoofers measure much worse this way than in a truly anechoic room. The 7" Scanspeak Revelators are good examples of this. The close mic response is deceptively bad but the 1m in-room measurements smooth out a lot of problems. If you took the close-mic measurements (as seen in the spec sheet) as correct you’d make the wrong crossover.

b - Baffle step - As popularized and researched by the late, great Jeff Bagby, the effects of the baffle on the output need to be included in any whole speaker/room simulation, which of course also means the speaker should have this built in when it is not a near-wall speaker. I don’t know enough about the Klippel simulation, but if this is not included you’ll get a bass-lite expereinced compared to real life. The effects of baffle compensation is to have more bass, but an overall lower sensitivity rating.

For both of those reasons, an actual in-room measurement is critical to assessing actual speaker behavior. We may not all have the same room, but this is a great way to see the actual mid-woofer response as well as the effects of any baffle step compensation.

Looking at the quasi anechoic measurements done by ASR and Erin it _seems_ that these speakers are not compensated, which may be OK if close-wall placement is expected.

In either event, you really want to see the actual in-room response, not just the simulated response before passing judgement. If I had to critique based strictly on the measurements and simulations, I’d 100% wonder if a better design wouldn’t be to trade sensitivity for more bass, and the in-room response would tell me that.

3. Crossover point and dispersion

One of the most important choices a speaker designer has is picking the -3 or -6 dB point for the high and low pass filters. A lot of things have to be balanced and traded off, including cost of crossover parts.

Both of the reviews, above, seem to imply a crossover point that is too high for a smooth transition from the woofer to the tweeters. No speaker can avoid rolling off the treble as you go off-axis, but the best at this do so very evenly. This gives the best off-axis performance and offers up great imaging and wide sweet spots. You’d think this was a budget speaker problem, but it is not. Look at reviews for B&W’s D series speakers, and many Focal models as examples of expensive, well received speakers that don’t excel at this.

Speakers which DO typically excel here include Revel and Magico. This is by no means a story that you should buy Revel because B&W sucks, at all. Buy what you like. I’m just pointing out that this limited dispersion problem is not at all unique to Tekton. And in fact many other Tekton speakers don’t suffer this particular set of challenges.

In the case of the M-Lore, the tweeter has really amazingly good dynamic range. If I was the designer I’d definitely want to ask if I could lower the crossover 1 kHz, which would give up a little power handling but improve the off-axis response.  One big reason not to is crossover costs.  I may have to add more parts to flatten the tweeter response well enough to extend it's useful range.  In other words, a higher crossover point may hide tweeter deficiencies.  Again, Tekton is NOT alone if they did this calculus.

I’ve probably made a lot of omissions here, but I hope this helps readers think about speaker performance and costs in a more complete manner. The listening tests always matter more than the measurements, so finding reviewers with trustworthy ears is really more important than taste-makers who let the tools, which may not be properly used, judge the experience.

erik_squires

Hi Amir,

Hi Andy.  😀

Does the 1KHz tone that you measure on the DAC, does it tell you how good the bass is or how sweet the treble sounds? 

That's like asking me if there is a traffic counter that counts how many UFOs go by.  First you have to show that there is such a thing as "sweet treble."  If you mean rolled off treble, sure, the frequency response tests show that different filters have the ability to roll off high frequencies, making the sound softer which some people confuse with "analog sound" and I guess "sweet treble."

Here is sample DAC measurement data on that:

As you see, there are two filters that roll off starting as low as 12 kHz.

Do you have a test for these as well?

See the test for treble above.  For bass, I do run sweeps down to 20 Hz and often problems are seen there, sadly in high-end DACs such as the aforementioned PS Audio DirectStream DAC

 

This one gets you coming and going with rising distortion at both ends of the spectrum!  My listening tests confirmed the same with problem identified by the designer as cost cutting on the output transformer (in a $6000 DAC!!!).

Here is another expensive DAC, the TotalDAC D1-six which retails for whopping $14,000:

 

See how it either accentuates or attenuates high treble depending on filter setting.  

We can see lack of fidelity in how it handles SMPTE IMD tests which has 60 Hz+7kHz components:

Pretty sure this a "sour" treble instead of sweet.  😁

This is what its frequency sweep looks like:

 

Dude! I’ve had many other speakers 

How many is that exactly?  I have measured and listened to nearly 300 speakers of every kind possible.  

you a dummy!! Go measure a dac. 

I measure, review and listen to almost every audio product other than subwoofers.  I test speakers, headphones, phono stages, preamps, poweramps, headphone amps, cables, audio and power tweaks, DACs, ADC/audio interfaces, DSPs, room EQ, etc.  I am nearly 2000 audio products reviewed in just 5 years or so. 

You put forward a specific argument and I showed using stereophile that your comments are inconsistent.  You have no answer for that?

I am not surprised that i am the only one here Amir do not dare to answer...

Perhaps i am a bit too hard on him with real arguments with real science articles against his main claims...The others attack him on a ground ( his gear specs measures) where no decisive win is possible against him, they gave him " the cable "he need to win easily ...

Why not discussing what  hearing a sound quality means in acoustics?

Acoustics rule audio and gear design not Amir measures....

😊

 

Now read this attentively and you will learn why Hans Van Maanen is not in the ASR team but in science :

I read it.  Here is quote at the end:

As the work reported here is partly based on theory, partly based on experience, further experiments should determine if temporal decay can be used as a semi-quantative parameter for the perceived sound quality. It is not within my possibilities to do much experimental work on a scientific basis.

So no controlled testing to see if any of the assumptions in the paper are correct.

Disregarding non-linear distortions, the frequency response between 20 Hz and 20 kHz of a system is very often taken as a major parameter determining the quality of a sound reproduction system.

Disregarding distortion?  That is the very topic we are discussing.  I am showing measurements of distortion.  If that is out of the scope for this paper, why cite it?

That aside, I measure frequency response way higher than 20 kHz.  Here is an example, the JDS Atom Amp 2 Headphone Amplifier Review

This is a $129 headphone amp from an American company whose response keeps going past 100 kHz -- 5 times higher than human hearing.

It is trivial for many audio devices to have such wide bandwidth so it is not at all a test of how good an audio device is by itself.  

The temporal decay of high-end analog audio systems is higher than the decay of digital systems in their present version and consequently the temporal "smearing" of the formers is less.

Where is the evidence of this?  The paper defines a metric but never shows measurements of such in any audio device, high-end or otherwise.  What is the point of that metric if we are just going to assume certain systems are perfect at it?

One of the better ways to compare analog and digital systems is by listening to a good copy of an analog recording on disc and the CD made of the same master tape. If the digital re-processing would not audibly effect the signal, no difference would be perceivable. Yet, on a high-end audio system, using e.g. electrostatic loudspeakers for the midrange and high frequencies, the transparency and clarity of the analog version (half-speed master copies) invariably showed to be better.

Where is example of such content and controlled testing demonstrating that?  "Shown" how?  Where is his metric for either one of these systems?

Comparing loudspeaker systems is one of the most difficult and tricky aspects of audio. Yet, generally speaking, the loudspeakers sounding best are those with the highest temporal decay. To mention some examples: electrostatics, ribbon tweeters and last-but-not-least ionophones.

"Generally speaking?"  What does that mean?  Where are the real tests that show this?  Controlled testing shows that Martin Logan speakers sounding poor compared to traditional speakers due to resonances and non-flat frequency response.  Does he have results otherwise?

Here is a controlled study: 

 

"M" is Martin Logan electrostatic speaker.  Here is the preference ratings:

 

It finished dead last.

High-end audio systems often sound better with analog recordings than with digital ones. This is at first surprising because of the very high quality specifications of digital systems. But the temporal decay is one of the few points at which analog systems beat their digital counterparts and it is thus a clear hint of its importance.

Again, claims made without any evidence and lacking his own metric through any kind of measurement.

Netting out, his metric relies on bandwidth. The more the better.  It has little to nothing to do with the discussions we are having.  Nor is there any evidence or data that such a metric helps perceived fidelity.

 

@erik_squires - yes, the humour didn’t go unnoticed 😂 - my thanks was badly timed, I had meant to post it sooner, but didn’t get round to it. It was also perhaps, for the many other posts you have made over the years that I learned from but never acknowledged - audiogon may have its little battles and disagreements, but my journey of listening would never have been made if not for voices like yours and many others. I am a very new audiophile, made wise by the experiences of the many. Thanks again for it all 😉🙏🏻