Should I upgrade from a Mac Mini to a dedicated server or should I upgrade my dac?

My thought is if you’re using Roon and you DAC is connected via Ethernet like a streamer then it’s not as a noticeable upgrade (if at all) by adding a Roon NUC, SGC, etc. the big difference comes when using USB out of your mini, which you’d then definitely want a NUC, SGC, etc to eliminate the Mac. I use a mini into a etherRegen, into my streamer. 

Thanks Kray.
This was my thought when I moved away from USB and went to Ethernet (ie all Ethernet connections from router to switch and then to Mac Mini on the one hand, to the dac on the other).
I was surprised when several other audiophiles mentioned that the Mac Mini would continue to be detrimental compared to a dedicated server- basically suggesting that there would still be a high level noise or digital hash being passed on by the Mac. 

Admittedly this stuff is well beyond my competence and I am trying to assess if indeed a Mac vs dac upgrade path makes sense.

And I should have added to my original post that compared to my analog set up I always have a sense that my system has a certain digital "homogenous" sound, if that makes any sense,  This is something that bothers me about it and it doesn't sound right.  I have heard called digital glaze and other such descriptions and to my ears its there,  I am no way trying to suggest that one source is necessarily better than the other but with my current set-up I think there is room for improvement- but how?

IME a lowly Bluesound will be an improvement on the Mini. 
 

My CD player sounds much better than both into same Dac. I have not yet gone down the rabbit hole of all the different things you can apparently do to clean up all the internet crap. Maybe it’s worth it, I just don’t have the time or patience. Cds for me keep it simple.