The thing that makes this comparison tough is that in order to be valid, the amps you're comparing (class A to class AB, etc.) have to be the same in other ways as well . . . and this may not be the case in your experience.
I would hypothesize that the class A designs you're associating the "slow" sound with also are single-ended or zero-feedback designs that have a comparitively high output impedance, which will definately affect most loudspeakers' response in such a way as to change the way you percieve timing information.
I would hypothesize that the class A designs you're associating the "slow" sound with also are single-ended or zero-feedback designs that have a comparitively high output impedance, which will definately affect most loudspeakers' response in such a way as to change the way you percieve timing information.