Off center (not bent!) stylus?

@whart got it thanks for that. So do you always play your records from the first track only?

@hauie88--Nope. Back in the day, I often only listened to a selected track or two from an album, then flipped to something else. I was pretty careful to drop in the dead space between tracks, but I'm human and that's an imperfect process. 
These days I do tend to listen to full sides, particularly since a lot of what I've been listening to is '70s spiritual or soul jazz and some of the tracks can take up a whole side. I will still, on occasion, do a needle drop of single track though. (I've become less dogmatic about a lot of things in my dotage). 
My concern was exacerbated by the problem(s) with your cartridge--not just aiming, but the potential for mistracking and needle dropping with a skewed cantilever could make matters worse in terms of damage to the record. 

the skewed cantilever will not significantly increase record wear but the azimuth error sure will. The diamond is pointed in the wrong direction!!
I explained the damage this will cause above. The cartridge will sound fine with a replacement stylus. So, go here https://www.lpgear.com/ and see if they have a replacement for it. Check out the cost and tell us what you find.

You will not find genuine Pickering replacement for your XSV/5000 cartridge, this cartridge is extremely rare and genuine stylus is very hard to find. Do not buy fake styli, the goal of the original is Stereohedron MKII stylus profile and Samarium Cobalt Magnet!

Regarding position of the cantilever please look at my image of XSV/4000.

Stereohedron stylus was manufactured by Expert Stylus & Cartridge Co in United Kingdom for Stanton/Pickering. Now same company is a re-tipping/refurbishing service. Because Stereohedron was Stanton’s Patent the new stylus from Expert Stylus & Co. called Paratrace. If you want to refurbish Pickering/Stanton then Expert Stylus in UK is what you need! 

Contact info for you: 

Expert Stylus & Cartridge Co
info@expertstylus.co.uk 

Last time I contacted them in 2016 and it was Julia Thompson (Client Liaison).
She was very quick with replies by email 

Thanks all - looks like LP Gear does have a replacement at a decent price so that is an option for sure. 

@chakster Thanks for the info on Expert Stylus - I will definitely contact them. 

Also I heard back from Soundsmith and their diagnosis was indeed that this is too far off angle to be innocuous. Most likely it is due to wear in the housing / base of the cantilever. Channel separation and tracking error are potential issues and I have heard both those problems. 

Also the guy I spoke with (Peter Green, not Lederman) said that they can only retip stylus assemblies that are not "user replaceable" and therefore he thought this one would probably not work for retipping. 

Lastly he said (I'm paraphrasing) that in terms of cartridge vs stylus, it is the cartridge that determines all the characteristics of the sound reproduction while the stylus and cantilever are responsible for providing the information to the cartridge.

So it seems to me that as long as a replacement stylus assembly is made with care and with the same materials as the original you can largely replicate the original sound. So sounds like Expert Stylus is where to go for this model!