This is *starting* to sound like the preamp is off the hook. Did you make sure a jumper is there between pin 1 and 3 of the XLRs? If that is missing it may not matter what the source is.
A balanced amplifier has 2 inputs: inverting and non-inverting. When you are using the RCA input you are usually using the non-inverting input, which is often the same as pin 2 of the XLR. If you don't install the jumper the unused input can pick up noise.
A balanced amplifier has 2 inputs: inverting and non-inverting. When you are using the RCA input you are usually using the non-inverting input, which is often the same as pin 2 of the XLR. If you don't install the jumper the unused input can pick up noise.