As mentioned, a star ground for all components is recommended. In reality, trial and error may reveal less groud loop hum with some components not connected. It becomes more magic than science, the scientific reason being discovered after the fact. It is worth going through a "finished" system with a scope on the output to get a few dB more S/N.
