speakers add the most distortion and coloration so you have to start with speakers you like the sound of that fit your room. All this crap about the guy from Naim declaring source first is just that,,,, crap from a guy who sold sources...
Put a $1000 all in one streamer/integrated amp with $100,000 speakers.
Then put a $100,000 front end with some $1000 speakers.
I can guarantee you which one will sound better.