The idea that speakers is the most important part of a system is not an absolute...
There is, for most of us, ordinary owner of ordinary speakers, under 10,000 bucks, a more important factor, the room acoustic controls that can help or impede, or compensate in some degree for the limitations related to any "ordinary" speakers....
My 10,000 bucks borderline limit is arbitrary but the fact i pointed to is not...
We listened not to speakers but to a room integrated to the speakers.... the 2 are ONE organ producing the 2 different acoustically mixed frontwaves of sound which each one of our ears will process for the brain to create music body....
Imaging, listener envelopment factor or LEV are related on timing tresholds linked to these 2 frontwaves interacting coming from each speaker...There are "more" power related to acoustic than to the spec sheets of the speakers... Timbre perception will greatly be affected also by the distribution of the pressure zones in the room related to his geometry, topology but also to the timing of the frontwaves but also to their crossing of different pressure zones...
Acoustic is queen, the sleeping princess, speakers are only the biggest of the 7 dwarves...
For most of us, owning normal speakers at normal price, the room acoustical settings will determine our impression about speakers more than any other factors in play....
Average Speakers are like average headphones, they all have many problems that are linked to the shell/room controls....
The only "relative" apparent exception are some very costly headphone or speakers set that are out of reach of most average users anyway....They can sound good in spite of some acoustical property of the room or less limited by their "shell" particular design....