It's always the "sound" to start, but it doesn't last long.
I started out listening to the sound until I got my system where I wanted it.
These are some of the honest feedback. I am in the same boat.
I think that many audiophiles feel that they will be looked down upon, if they claim that they are moved by sound rather than music. It's almost like "audiophile" is a derogatory term and "music enthusiast" is the acceptable norm. And yet we try to make our sound/music as close as possible to reality. Strangely 1% or less of the entire human population are the people who care for their music to be reproduced as accurately as possible, trying to get the best (within budget) DAC, amp, loudspeakers, etc.