Balanced makes for a more reliably low noise system. Others have noted hum, earth loops and noise can creep into single ended systems, requiring detective work to locate and rectify.
There is also talk of more gain with balanced. As I understand it the extra 6dB is a lower noise floor rather than extra gain. Anyhow, this is a free benefit from running balanced.
I have run my whole main system balanced for about 30 years now, from cartridge to power amp. It is very quiet and I don't get noise problems. There is a little additional cost on cabling, but otherwise it's a free lunch.