DAC Measurements vs Actual Experience


I have spent the last two days evaluating which of these two DACs I will be keeping:
1) Benchmark DAC3
2) PS Audio DirectStream

I'm foregoing the use of a dedicated preamp; the chosen DAC will serve that purpose.* 

I had read up on the technical side of each of these exhaustively before purchase. For those of you who aren't familiar, the Benchmark DAC3 measures quite well in every category. The PS Audio DirectStream, on the other hand, not so much. In fact, Audio Science Review places these two near opposite ends of its SINAD (signal-to-noise-and-distortion) list with the PS Audio being positioned near the bottom. Stereophile also provided measurements in their review that painted the PS Audio in an unfavorable light. 

And yet the DirectStream is proving to provide a sound that is more, dare I say, musical. It's a bit more relaxed, sounding a tad reserved in comparison to the DAC3, and the presentation of 100 Hz and lower seems to be slightly vague, but it's also less edgy, possessing a better soundstage, and is overall ever-so-slightly more enjoyable. So what am I doing wrong?

* Is it worth considering putting a dedicated preamp downstream of the DAC3 in hopes of gaining a more favorable sound? 
sixfour3
@sixfour3,

As someone who believes in science, measurements, and subjective listening, I believe there are some serious misconceptions about "measurements", and the position that those who use measurements take, and what they mean. That misconception comes from blind attachment to absolute measurements (a well known audiosciencereview person), as well as those on the other side who don’t don’t understand measurements or want to sweep them under a rug in all cases.

Measurements will never indicate individual preference. They may indicate, after large scale tests like Harmon/Toole did, that most people will prefer a particular set of measured values, but they will never guarantee what any individual will prefer.

Measurements may also reveal "uncomfortable" truths, like high resolution digital does have more "information" and can capture and play back what comes off that microphone more accurately than analog tape and vinyl. More accurately does not mean you will prefer it, and because of side effects of vinyl, there may be psycho-acoustic effects that allow more of certain types of information to reach your brain. Strangely enough, more noise can also allow you to detect lower level signals in some cases. Reduced information can allow you to focus on that which is most important which may be lost in a higher information "stream".

And just to "tweak" the never measurements crowd :-), while measurements cannot reveal what we will subjectively like, they are pretty good at identifying what can or cannot make audible differences, but if you are unsure, you can always perform an unbiased test with your ears/brain :-)



@roberttdid This is some amazing writing. I am going to email your post for future reference.
The psaudio has received many great reviews from pro to regular customers regardless of the measurements.
 I have one and love it even though I know there's dacs that measure better.
I've never heard a Ess based dac that sounded as natural and musical. 
When I can upgrade it will probably be for a chord, dcs or msb and not a standard chip dac. 

The directstream does also sound better with a preamp. 
The suite of measurements ASR runs through is meaningless in terms of making any purchase decision - granted it is one data point. Benchmark and ADSM both measure well, but ADSM sounds amazing and analogue but Benchmark sounds like POS.
So by that logic I can assume the ADSM sounds like a POS. Different strokes for different folks.