Yes , the Lyra stylus cleaner is excellent and they supply it with a great brush. It is a bit pricey but IMHO worth it. Many styli are held on only by a gob of glue. Many solvents will attack the glue and then I think you know what happens. The Lyra cleaner will not attack the glue.
mglik has already discovered that his problem is worn records. Old records that distort like that are usually very dirty. So if you are going to play old or used records cleaning them thoroughly is crucial to the life of your stylus. I would play them with a less expensive cartridge that has a replaceable stylus Like a MM Audio Technica. I will not buy used records for this reason. I have seen enough to know you do not want to trust anyone else's record hygiene.
mglik has already discovered that his problem is worn records. Old records that distort like that are usually very dirty. So if you are going to play old or used records cleaning them thoroughly is crucial to the life of your stylus. I would play them with a less expensive cartridge that has a replaceable stylus Like a MM Audio Technica. I will not buy used records for this reason. I have seen enough to know you do not want to trust anyone else's record hygiene.