Consider the vinyl setup you heard, if you really liked it than that might be what you should go for then decide on your budget, you can spend as much as you want. Do some research to find what cartridge(s) you might like. Look for a used turntable with the arm that will work well with your chosen cartridge. If you have a $3k CD player you might consider that as a budget ballpark. I have more invested in my phono setup (new tt, used arm and cart - not including the phono preamp) than CD player.
Carl
Carl