It might depend upon your tastes, right? If Led Zeppelin is your forte you might not be excited by a complete Montovani collection. The music should come first, regardless of the medium.
If it's just having lps for the sake of having lps, be aware that many current (expensive) reissues use digital files due to deterioration in master tapes from earlier years. So if keeping it all analog, all the time, is important, I wouldn't buy any of these reissues unless they come a site that specifies they don't use digital files, and isn't being cute and misleading about it. So I would be looking to acquire ups issued before 1990 or so, and expect to receive them in all kinds of condition.