How to lower noise floor through mods?


I have an older tube preamp which I like very much. It has something of a lush "romantic" aspect which I quite enjoy, and while it is not 'noisy', it is not the quietest pre out there. In addition, I think that one might be able to maintain the 'romance' but improve the transients a bit. I have done a fair bit of research on replacing the caps (which I should do anyway because of age probably), but I am wondering what mods would lower the noise floor.

Will new/better caps help? Resistors too? Tubes? Is it new wiring for the point-to-point parts?

Modders & Manufacturers, please toss your 2cts in! I would love to hear your experiences and wisdom. What will keep the 'romance' and euphony while lowering the noise floor and improving transients?
t_bone
The "filter caps" are in the power supply. If you can still find Black Gate/Rubycon caps in the exact value that you've got in your pre now: They'd be a much higher performance replacement than the originals. I absolutely agree with Atmasphere- If your pre has tube rectification: Ignore my suggestion to go to FREDs.
I've investigated replacing the electrolytics in my Cayin power supply with a better electrolytic. Problem is the Black Gates/Rubycons are too low voltage rating (at least I've not found a source for higher voltage) for use in power supplies. I suspect he probably has decent electrolytics in his power supply, likely some better model of Nichicon, bypassing/shunt with film caps may be his best bet. I'm going this route in my power supply.

I believe coupling caps are the biggest bang for the buck, sonically speaking, these should be somewhere near the signal tubes. Not a job for the novice, find an experienced tech.
Have you thought of adding a power conditioner to your system? This made a big difference in my system.
There's some gear that responds extremely well to balanced AC. Had a SFL tube preamp that was a completely different beast when given 60/60.
I have a power conditioner that i have only ever used for my CD player (which I was using to isolate the other pieces from the CD player (which worked quite well). I can try it out to see what happens if I plug in only the low-wattage stuff (pre, phono, TT). Pretty soon you guys will talk me out of doing anything to it...