The tail does not wag the dog. When people do speakers first, that is exactly what they are assuming.
The dog, in this case, is where the signal begins; be it cartridge or CD. This is followed by pre and amp, and those are items that should be as high a quality as you can muster. High quality speakers are more expensive than most of us can afford in the beginning; however, if you have good electronics and source, you will hear more music than with the best speakers and middle of the road electronics. Use what's left to buy as good of speakers as you can get, and plan on high quality speakers later on down the road. Remember, you can always use speakers elsewhere in the house, or sell your initial speakers.