Vinyl has a sound: noise (noise: swoosh, ticks, pops). However, the sound of the music is "colored" because most phono cartridges do not have a flat frequency response. So... I believe people like (or don't like) the sound of records because of the "built in" eq of the gear used during playback. Phono stages have a profound effect on the tone of the music too. Completely neutral (ie flat frequency response) phono gear is extremely rare and when it is heard, can sound boring or practically identical to a cd with the same mastering.
The advantage of vinyl IMO, is the unique mastering (often superior to CD) of the pressing, and is the real advantage over digital in terms of audio quality.
That being said, I prefer listening to records because they have a more engaging experience.