Funny coincidence it may be, since I just now been playing two records (at least) I can hear what sounds like speed instability too.
On my Ortofon M20 (MI type) I changed the FL super stylus insert to the E super. This one has a VERY high compliance of 40cu, double that of the FL super.
So what seems to happen now, that slightly out of centre LPs are 'pulling' the stylus back and forth while negotiating the outer grooves, clearly visible as it happens.
The effect is a listening perception of speed instablity, a kind of 'groove wobble' induced wow!
So definately no arm-damping for this type of high compliance stylus / cantilever insert - and next no anti-scate force setting - if any!
As it also will act as a form of damping on the tonearm's lateral free movement.
The more restricted the movement will translate into unwanted horizontal cantilever deflections, and my best guess, sounding like wow, and more noticeable with slow drawn out music passages.
Examples are opening passages of 'Giselle' Act I and II.
One more would be 'On the Beach' by Chris Rea.
Both my LPs have slighly out of centre holes.
Michélle 🇿🇦