Men are more inward which allows them to enjoy listening to music which typically is done without much conversation. Women are more outward and enjoy company and conversation which is not conducive to critically listening to a hifi system where you are either listening to enjoy, which is a non-talking event or to figure out which item needs to be upgraded next, which again requires quiet.
excellent and accurate observation, i think