Csontos, you are spot on.
The specs an amplifier has on paper don't reflect the whole story though. An amplifier with very low distortion with steady state signals (sine waves, used to test for distortion) can act quite differently when asked to reproduce a waveform that is constantly changing.
The feedback used in the amplifier can have a huge bearing on this phenomena. So it does not follow that the lowest distortion on paper will also be the least fatiguing.
Generally speaking, the use of feedback in an audio circuit will reduce most forms of distortion but will leave audible amounts of odd ordered harmonic distortion caused by the ringing of the signal in the circuit due to propagation delays in that circuit. In a nutshell, the feedback always arrives back at the input of the circuit slightly too late to do its job right.
The higher the frequency, the more pronounced this problem becomes. Since our ears use the odd orders to sort out how loud a sound is, essentially the use of negative feedback in an audio circuit violates one of the most fundamental rules of human hearing. To avoid this you have to avoid the use a negative feedback.
Such amps and preamps that do so will seem to have higher distortion on paper, but quite often will have less listener fatigue on this account.