Just one opinion here, but you asked for them, right? The Esoteric X03SE is an unusually good CD/SACD player, your cartridge merely good; a better cartridge would improve the sound of your LP’s. A cartridge is like a loudspeaker, a transducer. Both greatly determine your system's abilities to accurately reproduce vocal and instrumental timbres, one of the most important aspects of music, imo, and of a hi-fi system's jobs.
Speaking of LP's, how many do you have? How are you going to play them if you "give up on analogue playback"? By "give up", do you mean sell your table? And what, get rid of your LP's? How much does the music they contain mean to you? Why do you have so much more invested in your digital player than in your table? Do you have a lot more CD's than LP's? Were you thinking of building up an LP library? Time to think long-term!