I have owned both the Ayre C5XE and the Esoteric X-03.
I originally sold my Esoteric and bought the Ayre. I couldn't wait to get back to Esoteric. I kept the Ayre machine for a couple of months and missed the huge panoramic soundstage, the awesome dynamics, and the finely defined image placement of the Esoteric. I also missed the build quality of the Esoteric and the player's VRDS-NEO transport mechanism - that just works better and just seems to be of much higher quality than the Pioneer mechanism in the Ayre. In fact, the Ayre refused to play some of my discs - a problem I've never had with an Esoteric.
To my mind and to my ears, the Ayre sounded like an extremely good CD/SACD player. The Esoteric just sounded better. A step closer to the sound of real live music.
I sold the Ayre and bought another Esoteric X-03. Love It!
I have now had the X-03 modified by Reference Audio Mods (their second level mod) and it now sounds incredible. Certainly the best I've ever heard.
I now have the modified Esoteric in my main system and a Cary 306 SACD in a second. To me, both sound superior to the Ayre C-5Xe.