Best way to A/B two different streamers

I would not use a switch. Will confound the analysis.

After both are broken in I would try one day one then one day another. Do that a couple times to see if there is some really huge difference. Then I would listen to the music from one for a couple weeks. Then switch, listening for a couple weeks. Do this a couple times and the differences at all levels should become obvious. 
 

If you really want to understand the differences at all levels you have to listen to the music and not the equipment and the differences will unfold.

@ghdprentice - I tend to lean towards this approach.

OP - You should have a sonic memory for the computer, so listen to the new streamer for a few days or weeks and see if you feel that something’s different.  Then go back and verify. If you can’t form an opinion then you’re splitting a hair not worth splitting.

I have found that I have formed an opinion with something new and then when I switched back it was clear that my sonic memory was flawed.  Other times I’ve found it a relief to switch back. Other times the difference was so immediately obvious that I never bothered to go back. 

I just did a shootout like this a few days ago.

1) Connect each to whatever inputs available that both support the source resolution for testing.

2) Stream the same source material with both concurrently

3) Compare. I’d use a sound meter or similar app to make sure both are same volume.

4) Pick the winner and on to round 2 repeating same test but with different input configuration as the challenger if available.

5) Repeat as needed until a winner can be determined from among all the available streaming options at your disposal. 

My recommendation would be to listen to the streamer for at least 3-4 days to get to know its sonic signature. Then switch to your computer as streamer. Spend another 3-4 days if the differences aren’t immediately obvious. Make a playlist specifically for this comparison. Make notes of what you hear. 
If you must use a switch to go between the computer and the streamer, still avoid quickly switching back and forth. Go thru the entire song with computer then the same song in its entirety with the streamer. But…in my opinion using the usb switch can impair the sound quality and you will end up making a mistake…potentially…

FWIW, In every comparison in my system, my mac mini could not match the performance of a dedicated streamer. I used Auralic Aries G1 and Lumin U1 Mini for the comparison (USB cable was Audience AU24se+).

Willy,

You’re getting some non-optimal advice here.  People are right that you should NOT use a cheap switch.  Nor should you use an optical on one and USB on the other.  Neither will provide a valid comparison.

Pick 5 to 10 tracks that you feel are very well recorded and that you really enjoy.  Be sure to include some acoustic instruments and vocals that you’ll recognize as sounding “real” or not.  Some complex rock is fine too.  Be sure to include some cymbals and kick drum or bass drum.

Listen to the entire group and listen for specific things on specific tracks such as cymbal strikes, sibilant voices, deep bass, transients, handling of complex passages, clarity, soundstage depth, width, specificity, etc.  Take notes on how “real” each track sounded and of course, whether you found it emotionally involving.  Did it make you want to keep listening a lot longer or did you find yourself wanting to do something else?

Then go through the same group with the other streamer, hooked up EXACTLY the same way.  Go through the whole process 2 or 3 times.

Quickly switching back and forth between pieces of equipment within the same track seldom tells you whether you want to live with a new piece of equipment or not.