Assuming that the components are of a certain caliber (that statement really needs to be qualified), I'm of the opinion that listener fatigue is primarily the result of poorly designed or no AC line conditioning, poorly designed or no vibration controlling apparatus', no dedicated AC circuits/lines, and poor choices in ics and speaker cables.
One can own the very best components, but without properly addressing each of these other items, one is likely to be doomed for mediocrity and much listener fatigue.
-IMO