alex, why should taste in music be any different from other experiences in life? Fortunately we males are not all attracted to the same characteristics in women. Individually we favor different foods. Art and literature are varied and each type appeals to different people.
With music, like most things, I expect a big influence is what we grew up with, what is familiar. As we grow older then tastes of trusted friends can have impacts on us. From there it becomes a difference of personality type. Some are happy with what they know, so they stay with that. Others are more restless and seek out new things, as much for change as anything else. They tend to evolve more as their circle of taste expands. What we like or don't like is the result of individual personal experiences up to the present moment in time.
Others here might suggest different reasons.