How to assess and quantify system improvement and changes?


In one of the currently popular threads, a number of members (all of whom I respect) have made significant claims regarding system improvement.

For example: A recent post mentions "a double or triple improvement in my system." A conversation a few days ago with two audio buddies had them quantifying a DAC change as a 10% improvement by one and 30% by another.

This, by virtue of our pursuit, occurs throughout our discussions in the various threads.

Starting this thread to see if we can mine the collective and come up with guidelines and outcomes that are reproducible, relevant and reliable for comparisons and discussions between audiophiles.

Thanks!
david_ten

Showing 2 responses by david_ten

@twoleftears  Agreed on the needing luck! : )

Your point on 'hyperbole' is well taken and applies. However, as @cleeds  correctly points out, it's present on both sides... whether the descriptors are positive or in favor and / or those negative and against.

I have been guilty of this and I've been 'reining' it in, so to speak, as best as I can for myself. Disciplined control....

@slaw  Of course. Each of us will describe the things we try in our own ways and to varying degrees (relative to others) and that's one of the reasons for this thread.

I'm proposing we work on defining the 'metrics' we tend to throw out there when we describe our system or other systems.

Perhaps something of this nature has been worked out and is available? If so, can a member in the know share the links, etc.

How we share what we experience is critical to our hobby. I'm asking for a methodology that can be (more) accurately understood and be (more) consistent across audiophiles. 
@inna  funny and thought provoking.  And I get the point. : )

@ebm  I'm honoured. I figured a "Let me think really hard about that and get back to you tomorrow!" : )

Seriously though, take a stab at it if you feel it's worthwhile.