The audio horizon dac 3 has an input selector that is used to select between either 1) RCA INPUT or 2) XLR INPUT. This selector does not have anything to do with the output selection.
From your above post, the dac is connected to the transport using a RCA connection; therefore, the dac's INPUT selector must be set to RCA for any signal to be outputted in either RCA or XLR output.
Do you get any sound when your dac is switched to RCA INPUT mode? It is not clear that you have tried this.
From your above post, the dac is connected to the transport using a RCA connection; therefore, the dac's INPUT selector must be set to RCA for any signal to be outputted in either RCA or XLR output.
Do you get any sound when your dac is switched to RCA INPUT mode? It is not clear that you have tried this.