I suspect many won't take you seriously with idea of using your computer as high quality streaming source.
I ran various modified mac minis for years and presently use Windows based custom build at present. While my custom build has virtually nothing in common with a general build Windows machine, I do believe one can create a decent streamer with certain mods to general service Windows machine.
I doubt more than minimal improvements with power supplies you mentioned, much better would be HDPlex optimized SMPS allied with external LPS HDPlex 200W dc-atx cost around $70, sufficient lps to power HDPLex will be $400 up.
Assuming you have sata drive, ssd will be nice improvement over HDD.
JCAT or Pink Faun usb card would be substantial improvement over any other usb card or usb off motherboard, a little pricey but worth it!
Optimizing your OS is another substantial improvement you could make, something like Windows optimizer, I use Euphony OS. Be aware these OS modifications will severely restrict or eliminate use of your computer for general service needs
I believe this is minimum for what I'd do for modifying general service Windows machine into music streamer. Without all three of these changes you'd be greatly limiting potential of this machine for music streaming duty. You could do any one or two in isolation with incremental improvements, but not really worth the effort or expense.
As for total costs here, think $500-$1500 for power supply via HDPLex route, ssd could be anywhere from $75 to multiples of $100, one could have OS only on ssd, storage on HDD or everything on ssd. Nice usb card around $800, Windows optimization could be anything from diy for free to subscription to Euphony or another OS for $200 up per year. So bottom line cost here could be as low as something less than $2k-over $3k. Weight this against what an off the shelf would cost, come to your own conclusion. Keep in mind to reach this level the Windows computer can no longer be used for general purpose. If still needed for general purpose you'd be better off going with dedicated off the shelf streamer. Eliminating the many processes Windows general service computers running is absolutely necessary to hearing potential of the other mods.
I go into this much detail because this is exact place I was at some months ago in determining whether I was going to go with diy mods to Windows based computer or off the shelf. In my case this was all out assault, so comparative purchasing decision was to machines like Antipodes K50, Innuos Statement, Aurender W20SE. I chose extreme custom build Windows based mostly because I'm the type that loves bespoke solutions. Whatever route you take, I'd not cheap out, based on your system description, I'd expect you'll hear the improvements brought from a top quality streamer.