Objectively and (I'd gamble the consensus would agree) subjectively speakers, vary in more ways and by greater degrees than any other component. Perhaps more so than all other components combined. Speakers vary more with different listening positions than any other component, Perhaps more so than all other components combined. Speakers vary with rooms more so than any other component. Perhaps more so than all other than all other components combined, save perhaps for vinyl rigs. Speakers are more colored than any other component, one best make sure that those colorizations line up in such a manner that precludes highlighting specific listeners particular irritants, coincides within the specific listener's room, at the specific listener's listening positions.
In order: budget, room, listening positions, speakers, amps, etc..