Looking to build a system for under $5k

+3 for Vandersteen's. +2 for Johnny R at Audioconnection.
The Vandy 1's with subs can be a killer combo. Paired with a used McCormack amp and preamp, and a Schiit DAC. and some AudioQuest cables and you should be under $5K.
Though I am a Vandy fanboy, I really believe they aren't only the best deal for an accurate, listenable speaker, but also a good foundation upon which you can compare other speakers.
Bob

You got 5 grand to spend so don't let others do it for you.

And there are no components that offer a best bang for the buck.  If there were, that's all that would be available at a certain price point.  Everyone would want them and nothing else.  Instead there are hundreds to choose from.  So, there are only those components that work best with each other. 

Go to a few HiFi dealers and start auditioning speakers to find the pair that sounds best to you; not us. Vandersteens should be definitely be heard but whose to say your won't like them in favor of something else? If there are no dealers in your city, then day trip it to the nearest one that does.  Or plan on attending a 2 channel audio show. If your in the Midwest, Axpona is coming up in the Spring in Chicago.  In other words, take you time and do it right.

Don't be afraid to use half your budget for the speakers.  Build your system around these.  They are the only component you can actually hear and will be responsible for the final outcome from all sources.  Then look for an integrated amp that will properly drive those speakers.  Its ability to drive the speakers you have selected should be the first consideration in picking it out.  Everything will just be a feature like a phono stage or DAC.  These things can be added as external devices.

After speakers and integrated amp, then get your CD player with what's left.  Since you said vinyl would be down the road, then start saving all over again.  To do vinyl right will cost a lot more than a digital source.

Have fun and happy hunting!

Keep this in mind With loudspeakers under $3'k you will jot get real low bass 
If on s budget a good stand mount and a decent powered sub would get you much more low bass.   A solid integrated for example from Rogue .Kimber 8Tc ,and interconnects.you den even get a digital player for around  $1k 
A Schiit biftost under x $500 for a quality dac ,even thd little Aufioquest even cheaper and will support MQA recordings. And remember your epeakrrs sensitivity the lower it is the more power to drive them.  Also don't forget 
You can buy used and savery  a bunch of money.

$5K used will get you a lot more than new components.

First, decide which speaker you want because this will have the most significant affect on sound. This should be first if you want to have success. Good comment above about remembering that low efficiency speakers will require better amps and may push you out of your budget.

Second, find an integrated the synergizes well with your speaker choice. 

Thirdly get your source player, the best you can afford, and then if you have some budget left over some reasonably priced power cables, interconnects, speaker cables.