I never thought I would suggest looking at Topping, but here is a good review of the new Topping d90 III discrete - , discrete meaning it is not like their other DAC’s, it is not a R2R it is a single bit DAC.
Sandu, great reviewer, talks about exactly what the OP is asking for: speed and energy (jump to just after 8:00)
Could tide you over until you save up for your 5k budget (?)