Best practices when conducting a DAC comparison

All dacs have different analogue outputs levels even if it’s by a 1/10th of a volt, how can anyone compare dacs sound, if the levels are not matched, even a minute increase in level will favour that dac in an A/B comparision.

Hi George. You are right. I have no disagreement with regard to the different output voltages. In my case, I compared the maximum output specification of the Yggdrasil (4.0V RMS (balanced), 2.0V RMS (single-ended)) and that of the Oppo UDP205 (RCA) 2.1±0.2Vrms. (XLR) 4.2±0.4Vrms) and concluded that for my purposes the output voltages were close enough to not be a concern.

I knew my comparison would be less than scientifically exactly perfect, however, I did want/desire as accurate results as possible *and practical*. Practical being the operative word, and precise level matching may not be practical or necessary.

I disagree that a minute increase in level well *necessarily* favor a DAC in a A/B comparison. It may, or it may not. What I’m merely suggesting to the OP is that there are other factors besides "voltage output levels" that matter even more when doing the A/B. For instance, the Oppo treble is more "tinny" than that of the Yggdrasil. That is true regardless of the output voltage, and one doesn’t need to jump through hoops and level match to find out.

Obviously one does not want to listen to DAC "A" at 60db and DAC "B" at 100db. Sure, if the *result* of the output levels produce egregiously different volume then something is amiss and that could/would invalidate a test. But a 10th of a volt, all else being equal, I think not.

EDIT:

Should the OP have the proper equipment to precisely level match the output voltage, certainly there is nothing wrong in that and in fact that would be preferred. So in no way am I suggesting not to level match. Instead, I'm calling attention to the merit of doing so relative to other items and the likely hassle involved in attempting to *precisely* match.

@georgehifi  and @gdhal  Thanks for your thoughts on the level matching point you are making and are mainly in agreement on. 

@stfoth  I like the 'enjoyment' part of your assessment. Your primary suggestion on how to go about the evaluation is valid and has good company in that it has also been offered up (similarly) as an approach by a couple of others. 

My way to audition a new DAC is with music (a) that I am very familiar with (b) with a mixture of recordings that I love and hate on the existing DAC. Recordings one loves should sound equally as good or better with a new DAC. Just as important is when recordings that grated on you with the old DAC no longer offend and become interesting to you ; these are signs you have fixed a broken area in the old DAC. The pop genre tends to be sprinkled with recordings which excite bad sound on lesser DAC's.

Most DAC improvement is in increased detail   and reduced digital artifacts. DAC's can have tone color signatures (lean/lush/neutral) which will also affect your preference. DAC's also cannot produce what doesn't reach them correctly, anemic bass and blurry detail for accompanying instruments can be signs of jitter issues with the source solution feeding the DAC.

I have MQA in my beloved DAC, and it's disabled. I find I prefer high resolution with a different filter than it demands. I don't hear a benefit of MQA. Sorry.

As for auditioning, make sure both components are 24 hours warm and broken in. YMMV, but that's a more fair test. Ice cold, some DAC's do better than others.

Next, compare red book as much as high resolution. Don't assume that the DAC which has the most difference is the better one. The last generation of DAC's play red book exceedingly well. The previous generations only played high rez well.

Best,

E