In order of importance:
1) Good circuit/crossover design.
2) Parts choices (and spending your parts budget on the parts of the circuit where quality parts will make the most difference).
I will also add that in my experience a good power supply in a component makes a big difference. Particularly in amps and preamps. And quality transformers matter (for power supplies, tube output transformers, and SUTs for LOMCs).