There is a difference but I suspect that most audiophiles are music lovers to some degree but I'm not so sure that a music lover is always an audiophile. One is about the accuracy of reproduced music and the other is simply the love of music whether it is reproduced or live. I don't see a problem with being both or being just one.
Do you?
An audiophile is a person who is
enthusiastic about high-fidelity sound reproduction. ... Audiophile values may be
applied at all stages of music reproduction: the initial audio recording, the
production process, and the playback, which is usually in a home setting.
A music lover is: One who loves music
I personally enjoy the pursuit of recreating music that I love in my own living space.
Sam