There are probably levels of critical listening -- sort of like a second degree black belt compared to a fifth degree black belt. Heck, I don't know where I am along that path and I really don't much care. I know what does and doesn't sound right to me but have difficulty articulating it in the exact (?) language of the press. That knowledge and language does help focus my listening though. If I remember all my sociology, language is much of the basis of focus. Therefore, a speacialized language leads to a crisper focus. It helps me to read and share ideas because it leads me to a wider focus.
For me, critical listening is a means to an end. From time to time, I focus on and notice some of the shortfalls and try to correct for the ones I care most about. After that, I really just want to enjoy. I try to reproduce jazz most effectively, which introduces some compromises in other kinds of music and that's OK. It's never perfect so why worry so long as the glaring issues are subdued (of course, everyone has their own idea of what the most glaring issues are, but mine are the only ones that matter to me) and don't get in the way.
Good question.