I was just going to say, until Bob beat me to it, that live acoustic events can sound weak, thin, and not very image specific. Go one step further and play the same acoustic material at another place and the sound can and will change dramatically. Quite the can of worms, eh?
So, like Peterayer and Jmcgrogan2 imply (if I infer it correctly) is that an actual acoustic event can be not so neutral sounding as we'd like. I think this is due to our hearing acuity, which we should never doubt. Live events can sound wrong if out of tune or played incorrectly. Neutral is satisfying to our ears as no one part of the spectrum is out of line with the rest, drawing attention to itself.
I guess what I'm trying to say is that if something sounds pleasant, involving, and gratifying to us, it can be considered to sound "neutral", which then makes it very specific and therefore unique to each and every one of us. But a consensus can be arrived at that most can agree on. The same goes for our home systems even more since that is where we build and validate our beliefs.
All the best,
Nonoise