It might be unwise to extrapolate too much from this very interesting study:
https://jamanetwork.com/journals/jama/article-abstract/2800197
But it would seem to me that making an effort to broaden your horizons and seek out challenging music as you age can only be a good thing for both your physical brain and your mental health.
We should consider ourselves fortunate to have so much choice available to us, and also be among those who enjoy music. I know too many people who are fully indifferent to music, and they're far poorer for it.