Judging by the rest of your system you should look to invest some money in your digital side. But to get you going.
You want to buy a DAC. Given your price range I recommend the best Schiit DAC you can afford. It sounds like right now you are using analog outputs from your Pc. To get any kind if decent sound you will need to use the digital outputs to an external DAC and then input the output from that into your system. This will make a huge improvement.
Long term you should look at a DAC like the Schiit Yggdrasil or better and an external streamer of equal value and the music coming through will start sounding more like your vinyl. But to get equal sound to your vinyl you will probably need to spend about 20% more than your average component cost (preamp, amp, TT) on both a streamer and DAC… if that is where you choose to go.
In general, Schiit audio produces products that are great budget components and compete with other components of twice their cost in terms of sound quality.
Don’t waste money on a CD player unless you are nostalgic about playing with physical media.