I am almost there with my system, except that the midrange sounds harsh, grainy, and exceptionally digital. Female vocals in particular. It actually sounds like clipping, but I can hear it at any volume level. However, the problem is more noticable as volume is increased. I listen to a lot of acoustic music with prominent vocals, so this is a real problem.
I simply find it hard to believe that such good equipment gives you a "grainy sound" like "clipping". What you describe is so very much like distortion...and for significant distortion in such good equipment, well, my only guess would be that something may be damaged.
Some people describe over-driven tweeters as sounding as if there was "sand in the tweeters", provided of course, they have not completely blown. Of course, damaged equipment can output all kinds of distortion, depending on the exact nature of the problem; and if the tweerers were damaged then it might not affect your highs but produce a lower frequency distorted ouput which mildy affects what you hear in the critical mid range (where hearing is most perceptive).
Why do I suspect tweeters most?.....because you report something that is annoying and distorting but clearly not significant enough for you to immediately identify the problem. In my experience the tweeter generally does the least work and it can therefore be the hardest to detect when it has a slight problem....certain harmonics may excite the failure mode/distortion more than others...for your situation, it sounds like female vocals brings out your problem.