I agree with @charles1dad because you also like jazz at lower volumes. A nice tube amp could put some meat on the bones and as he says you don't need to worry about spending a fortune or chasing tons of watts.
But @jjss49 makes a great recommendation on that Hegel.
Since you are open to moving step by step, I think you could tackle the amp/pre side first, keep those speakers, and then get a good DAC for the Bluesound at some point.
Try your best not to get research fatigue. Keep it fun. It's a journey. Keep us posted.