Swapping out components can lead to an endless quest to find sonics that please you, but you'll still have the poor quality source files.
Since you're already into streaming, I second checking out the Bluesound Node2 with Dac.
You could research the possibility that the Sony Walkman can input to the Node2, or go analogue into your preamp.