One of the cheap tweaks I would use was to open up a cheap CD player and coat the inside walls and top with plumber’s putty. It would add about a kilo of weight to the CDP and dampen (reduce) the vibrations.
On most players it would make an immediately subtle, but noticeable, difference.