You will usually get a hum that may increase while your amp is playing music and the caps discharge. Bad power supply caps can no longer block ripple current.
http://www.kpsec.freeuk.com/powersup.htm#smoothing
http://www.kpsec.freeuk.com/powersup.htm#smoothing