The good news is that entry level high-end DACs are not that expensive now.
Try either Gustard A18, Denafrips Ares II, or Musician Pegasus. Any of these should give a noticeable improvement in sound quality, and then you can decide if you would like to spend more on better DACs.