Hi folks, I know this is subject of controversy. In general pure class A has been regarded as the best way in solid state amplification to get the purest sound. In my experience many pure class A solid state amplifiers (Accuphase, Pass Labs, Plinius) sound "slow" and are lacking "dynamics".
What you may be observing is simply a lack of distortion. A very high priced Class A amp is likely to be top notch. Furthermore, the design eliminates crossover distortion which is responsible for very high order harmonic disortion (in very small amounts but perhaps audible in some cases).
If you remove higher order harmonics (distortion) then music will indeed sound more laid back and natural - it will lack that edgy sound that you hear with most pop music today such as Red Hot Chilli Peppers, Green Day, Arctic Monkeys etc. (where distortion has been deliberately added in the mastering stage to make it sound "loud" - see CD loudness wars on google).
My speakers run Class A to two thirds power and I am very familiar with the harsh sound of modern pop CD's. The modern hypercompressed CD effect is such that they sound "fast" or "edgy" or "snappy" at low volumes (perceptively this sounds better to many people which is why the mastering engineers do it) - however - at higher volumes the sound is noticeably harsh and unpleasant compared to a properly mastered CD with proper dynamic range and without "hard-clipped" square signals (often, on a modern CD, a single track is clipped or flat-lined over 10,000 times!! I am not joking! If someone tried to sell you a towel and you got home and found it full of holes then you would take it back and demand your money back - this whole thing perpetrated by the recording industry is totally scandalous).
So laid back slow or natural sounding amplifier is GOOD, at least in this context, IMHO!!