It has to do with where our brain puts attention on stimulus. It can be rearranged in priority and sensation.
This makes sense. I've come across a few comments by guys who've said once they became aware of sibilance, they couldn't "un-hear" it. Could be, this is what's happened in my case. At this point, I expect it, every time I encounter vocals.