For me, the speakers are the heart of the system. They are what produces the actual sound that your ears hear. They need to be right and a fair amount of time should be spent choosing. When I got my first pair of speakers I drove all over the NY tri-state area listening to speakers. It took me months to decide. I ultimately ended up with a pair of Vandersteen 2CE. This was obviously many years ago. I've since upgraded in the Vandersteen line and couldn't be happier but setting up vandys take a fair bit of work and time. If your room is flexible and you have the ability to move speakers a lot before deciding on a placement then they could be an option for you but if your room is such that the speakers need to be in a certain place then they're probably night the right choice.
I will also say that they do pair well with Rogue electronics as that's what I have always had and continue to have. Not sure where you live but you can make driving around and listening to speakers a hobby for a while. Definitely do that before you make what will be a defining component of your HiFi.
The rabbit hole goes much deeper...