OP, Good question. The first time I was presented with this situation I was stumped as well.
+1 Absolutely, try and decide is the answer. Which ever sounds better. It is not an electrically question, but a sound quality question.
So. Listen to music with it connected one way for a few weeks. So your subconscious really understands what music sounds like connected that way. Then when it dawns on you… switch. If no obvious difference leave like that for a couple weeks. Then switch back. I think this second switch will answer the question clearly. If it does not. Then there really is no difference.