Unfortunately it is a bit like a black and white cookie. A very two-sided term: it can certainly mean one who loves audio, but it also carries a pejorative connotation of elitism, conspicuous consumption, and in some cases scientific rejection.
I suppose that is just due to the various personality types that make up the group, and the dynamics of paying a lot for something and then feeling the need to defend it.
I always love to see nests of cables and stacks of components next to records and CDs strewn about as indicating a true music lover who doesn’t think of the pristine equipment aesthetic, and the image it projects, as the highest priority.
While I am very interested in audio quality, I always try to distance myself from the audiophilia characterization because of those connotations. I am a music lover who is secondarily interested in how different gear works and interacts. More of a gearhead concept.
Either way, it’s all a tempest in a teacup. 99.999% of the world doesn’t give a hoot. And I may be a few 9s short.