Edit: lowrider57 said it more succinctly
I have very efficient speakers too (96 db/Watt), in a vinyl-only system, and have struggled with this. If your vinyl source is quiet with normal speakers, it will be equally quiet with efficient speakers - i.e. the efficiency of your speakers has no bearing on your perception of source noise. This is because you simply adjust your preamp’s volume control to get the signal level you need to achieve listening levels - and for efficient speakers, this will necessarily be a much lower volume setting, which rejects the source’s noise floor exactly in proportion to its signal (i.e. the signal and noise get equally attenuated, and then equally "amplified" by your sensitive downstream amp & speakers). Your vinyl source’s noise floor is a function of the quality of your phono stage combined with the output of your cartridge.
Where you can run into problems elsewhere in your setup is if your preamp and amp don’t have an adequate signal/noise ratio. That’s because these are your active stages downstream from your volume control - so any unused gain is going to contribute to your noise floor, with no chance to reject it via volume dial. This is going to be most egregiously demonstrated by tube preamps, especially ones with high gain. My tube amps are VERY sensitive amps (275 Watts / 1V input) so any residual noise from the preamp is going to be made extremely apparent. I’ve tried more than a few tube preamps, and the only one so far that’s been dead quiet in my setup is the Audio Research Ref 6 - very impressive! Stereophile posted some nice measurements of the REF 6 in their review, so I’d make sure to have a preamp at least matching its signal/noise.
In recap - use a preamp with as high a signal/noise ratio as possible, keep its gain on the lower side as much as possible, and if you can utilize amps with a lower input sensitivity (or add attenuators to the inputs if you have excess system gain to spare) then that will help too.
