I seldom imagine colors when listening. Instead I feel emotions. I feel adrenalin or soporifics...We all feel emotions with sound and music but we can also perceive specific acoustic information with sound and music...
The well known case of echolocalisation by blind people for example...Daniel Kisch on youtube is an example...
And the relation between emotions and information can be subjective or objective, objective like in the case of perfect pitch evaluation , or completely subjective like the associated specific colors attached to sound in synesthesia... And all the variation scale between these two....
The female violonist i speak about above with the youtube link about synesthesia own perfect pitch and "suffer" or "enjoy" synesthesia at the same time...