One thing to keep in mind is that RCA inputs prefer to see an unbalanced consumer -10 dB level. Most balanced XLR levels are at bare minimum +4 dB output. Without stepping down that level, it’s possible you could overload the RCA input, not to mention creating some nasty ground loops, by using a simple XLR to RCA converter cable. The more correct way to do this is with a passive step down isolating transformer device; like the Jensen PC-2XR.
The Ebtech Line Level Shifter accomplishes the same task for a cheaper price (and still has a ruler flat frequency response). With the Ebtech however, you have to use a 1/4" TS (tip/sleeve) cable to RCA, instead of an RCA to RCA like on the Jensen model.
Ebtech LLS-2-XLR Line Level Shifter
Are there no RCA output jacks on the phono stage? If there are, exactly what are you trying to accomplish here by using the XLR outputs?