Should I upgrade from a Mac Mini to a dedicated server or should I upgrade my dac?

Thanks Kray.
This was my thought when I moved away from USB and went to Ethernet (ie all Ethernet connections from router to switch and then to Mac Mini on the one hand, to the dac on the other).
I was surprised when several other audiophiles mentioned that the Mac Mini would continue to be detrimental compared to a dedicated server- basically suggesting that there would still be a high level noise or digital hash being passed on by the Mac. 

Admittedly this stuff is well beyond my competence and I am trying to assess if indeed a Mac vs dac upgrade path makes sense.

And I should have added to my original post that compared to my analog set up I always have a sense that my system has a certain digital "homogenous" sound, if that makes any sense,  This is something that bothers me about it and it doesn't sound right.  I have heard called digital glaze and other such descriptions and to my ears its there,  I am no way trying to suggest that one source is necessarily better than the other but with my current set-up I think there is room for improvement- but how?

IME a lowly Bluesound will be an improvement on the Mini. 
 

My CD player sounds much better than both into same Dac. I have not yet gone down the rabbit hole of all the different things you can apparently do to clean up all the internet crap. Maybe it’s worth it, I just don’t have the time or patience. Cds for me keep it simple. 

to get really excellent sound from a digital system, i think you need to do both - go to a roon nucleus or equivalent, and also, a high performing dac

in addition you will need noise filtration and management for the network feed... 

in my experience all are needed... 

One thing I'm not clear on. Are you connecting mini to ethernet switch or bridging thunderbolt out directly to Moon? Mini direct out to Moon would likely be preferable. You're doing well by doing no rendering with mini, could still benefit greatly with powering mini with lps, such as Uptone MMK and JS-2. So take thunderbolt bridge direct out to Moon with quality power supply, add operating system optimization and you have first rate non rendering server, essentially you have network device. Would take really top flight server to beat this setup. The issue with all this requires much diy work.