@jjss49 Thanks for sharing your approach. It's one I have used in the past but am cautious with now.
Why the caution? The conundrum(s) posed by optimization... and the resulting false negatives.
With an optimized reference system:
- if the exchanged component (like a DAC in the above posts) outperforms your "reference" DAC...the approach works.
however,
- if the exchanged component (like a DAC in the above posts) under-performs your "reference" DAC...the approach may yield a true negative OR a false negative.
For example, had you optimized your reference system around that "rejected" DAC...could you be certain of the outcome in that now optimized system with your current reference DAC. Maybe yes, maybe no.