I tried this in the late eighties, when I had a Mission PCM CD player that had a volume control on its remote. I had been playing this through a Musical Fidelity integrated amp, but just for fun one day, I got out its predecessor, the original NAD 3020 which allowed input direct to the power amp stage. The difference was absolutely striking in terms of increased clarity. Because the CD player reverted to max. volume every time it was switched off, I looked at passive preamps. The simplest and cheapest was a QED* switch and potentiometer that took one input and passed it through unchanged, and one that went through the potentiometer. So this added one switch, one potentiometer and an extra pair of interconnects into the system. I could hear it, or was sure I could. Not as good, but more convenient. I also tried a QED remote controlled passive pre-amp that had several inputs, all volume controlled. It wasn’t better.
But moving to other CD players, as they were developing and improving quickly in those days, I had to use one or other passive preamp as none had volume controls. Once I decided to reactivate my LP collection I had to move back to active preamps, and found the sound livelier and more dynamic, even if less starkly clear. I don’t really think now of one or other as better, but just different.
*I wonder what happened to QED? A British manufacturer of very high quality accessories in those days.