There is a reason: In most consumer (and professional) amplifiers the balanced signal is dealt with at the input by a differential amplifier necessitating the need for a series resistor on the inverting input. In the worst case the diff amp is the load seen by the source so the resitor needs to be large enough to present a reasonable input impedance (that's the 'relatively high' part).The bit that a lot of people are unaware of is that balanced inputs are actually noisier than single ended (RCAs etc.) in that they utilise relatively high value resistors that introduce their own (johnson) noise into the signal.This statement is problematic. There’s no reason why any such ’high value resistors’ be used in a balanced circuit that aren’t also in a single-ended circuit.
A better solution is to use an instrumentation amplifier which buffers the input so all you need to worry about is the ability of the buffer to supply current to the diff amp in which case the series resistor can be smaller. But in both cases there needs to be a series resistor that is larger than that required for a single ended input fed into a FET for example.
A transformer input is obviously different and more of a rarity but very beneficial for noise reduction and does a better job at dealing with RF/EMC. However transformers are far from perfect, don't have great LF linearity and HF response can be iffy, so no panacea.
Another option and perhaps the one that the OP was alluding to is feeding the balanced signal right through to the speakers using a bridged amplifier. I am less aware of the pro's and con's of doing it this way but I'd be interested to know what the measured CMR is of such systems as the gains of the two halves of the bridge would need to be very well matched.
My point was that balanced isn't 'better' by nature, just different and if you have a noise free environment with no ground loops it could be slightly worse.
In most cases my advice would be to go for balanced as there are likely to be more people who would benefit from the removal of noise at the input than would notice the additional noise from the circuit.