Because when you turn the key off the connection doesn't break clean it creates a transient pop and even though at that point the amps are "off" they still have more than enough in the power supply to make a very loud pop.
I know. Its freaking amazing the amount of stuff I know.
I know. Its freaking amazing the amount of stuff I know.