Hey.... psst.... buddy, don’t you really want to make your own speaker?? You really do.... :D Check out Madisound or Parts Express for a number of pre-designed kits.
The cabinet, drivers and crossover form an integrated system. Voicing is important and can make one speaker have a distinct personality from another. As a consumer, what matters most for you is the end result.
After voicing, the next things you might care about is the impedance curve, and the off-axis response to tell you something about the drivers and how well they were put together.
Somewhere in here part quality matters as well, with a very wide range in cost and quality. Some basic speakers, like Wharferdale Diamonds or low-end Focals really benefit a lot from tweeter cap upgrades in the neighborhood of $10-20 a speaker.
Caps are probably the part of the crossover that can impart the most character. Top end Mundorf is used by Magico and B&W for a reason, and while colorful not for me, per se.
Experimenting with caps early on is best done with self-made kits rather than expensive store bought speakers, and I think it's fun and you can learn a great deal more that way than by reading.