With any luck the new Dac may push the rest of the system to it’s limits. Then you realize how much really like the upgrade. but soon ya just want more. Then you upgrade, buy a sub, cables then upgrade xyz. So you tell me.
Does the significantly higher cost justify what might be a marginal increase in sound quality? Is buying a more expensive DAC for better sound just splitting hairs, and making you feel better about your system? Are different DACs just different coloration of the sound?
Only you can say. How far do you want to go? Keep in mind that its about the music, not the equipment and you’ll be alright. When you get to your destination, you buy less and less and enjoy