If we just stop the labels and the politically-correct behavior that is the trend these days. You will simply see a few undeniable facts.
1) Almost everyone listens to music
2) There seems to be close to a 1:1 of men and women involved in the music industry.
2) A small percentage of men are incredibly passionate about the hobby and this reflects in their journey. Some of us men know, reading reviews to 2 am can be very fun.
3) Hobbies that require you to sit for extended length of time are not appealing to women, think fishing and listening to music at home.
4) Concerts, and clubs, where sound quality is low and volume is high, have lots of women. There's just something about the dancing and socializing that appeal to them much more than music itself.
5) Find a woman with a home stereo system, they exist but good freaking luck.
We don't always have to put a label on things, sometimes labels are counter-intuitive and can make it less clear. The simple truth is, home audio is predominantly a male hobby. Sure every now and then a guy will jump in and say his wife enjoys listening with them. But they are few and far between. Which inevitably raises 1 question, would that woman be listening if the man wasn't home?
This is not sexist, you have to have an IQ of a clam to think women and men are the same, and that thought is IMO truly the sexist thinking that we don't need. Men and women are different, it is okay to accept it and embrace it. In fact it's even recommended to do so.