I have been using them at full. Since the knob is impacting both volume and gain, I am not sure how much it impacts the ability to use the full capability of the amplifier. You will, obviously, have to turn your source up further to get the same output.
You haven't been able to determine which of your sources (or if the preamp itself) is causing the noise?
You haven't been able to determine which of your sources (or if the preamp itself) is causing the noise?