if it is just thermal background white noise that is totally unrelated to the audio signal then you have a great piece of gear
I thought I would add that this is why analog tape hiss or Vinyl road noise (apart from wow and flutter) is not a big deal - we hear the music through this provided it is random noise.