What's your process for comparing new gear, cables, etc.?


It's a staple of many if not most posts to compare auditory experiences and attribute them to different factors — larger components (room, speaker, amp, dac, etc.) and the rest (speaker wire, cables, power) etc. This is how we choose new gear or compare what we already have.

Given the number of components and how short auditory sensory memory is, any comparison should change the fewest variables possible, as quickly as possible. (And auditory memory is short, even for simpler sounds. We compare using complex sounds and want to judge complex dynamic effect — soundstage, tonality at various frequencies, overall character or musicality, etc.) Doing things quickly is a challenge with tube amps, which must be shut down properly in order to swap things out. Then, they must be turned on and warmed up a bit.

I'm curious how people conduct their comparisons given whatever factors they contend with. Do you take notes? Have a standard vocabulary (e.g. the one in Harley's book)? Use a checklist? Have certain test tracks that you have virtually memorized? And so on. I'd like to know what works for you.

Most of the time, I'm just listening to music and enjoying it. But when I do want to add gear or make a change, it's natural for a critical comparison to call for some kind of procedure. I'm still trying to figure out what procedure can provide reliable, practical information. When my procedure seems too random or complicated, I feel a bit absurd — like I'm just doing kabuki-science! 


128x128hilde45
@tomic601 I completely agree. What these listening tests are doing for me -- besides evaluating gear character and quality -- is teaching me different things to listen for and different *modes* of listening.

Let me give an example. Last night, I was playing different tracks to test out my new system, and I decided to bring up some old school stuff I really love — "Rain" by the Beatles, and "Steppin’ Out" by Joe Jackson. I was amazed at how bad they sounded in comparison to, stay, "Babylon Sisters" on the remastered Gaucho album by Steely Dan. But those two tunes — Beatles, Joe Jackson — are classics, and I suspect that they were mastered to sound good on the average stereo at the time — main vocals and tune are *forward* and everything else just supports.

The question -- "How do I makes these sound better? -- How do I get back to the music (other than my forcing my mind to disregard what I'm paying aural attention to)?" then divides for me: Do I want a remastered version of those tunes (there is for Joe Jackson, and it sounds much better) OR do I want a way to set my stereo so that it plays in a more "down market" way. This is where a DSP or equalizer might be an interesting addition.
kren006, congrats on being one of the very few people who understand how to actually compare cables. I find that the majority do not compare sets, which is the only way to hear what the manufacturer intended. I first started comparing sets of cables about 17 years ago, and it was revelatory. It's the only way to make certain progress with cables. Mixing is largely guesswork and waste of time for no set direction/result. 

You may not get surprising or large results from the cables sets if they are constructed similarly and have similar AWG. It is not uncommon for cables of similar construction and AWG to sound similar. Your selections according to price point may not vary enough to overcome that issue. But, there will probably be at least some variance, perhaps one will be quite noticeably superior.