Like MC says, keep swapping leads, all the way back to the cartridge itself if necessary, in order to differentiate between a problem in the CJ, phono only or linestage, and then the cartridge and related ICs. Localizing the problem is what you must do first, before anyone outside your listening room can help.
this is a complete shot in the dark, and it is no substitute for doing the work that MC suggested, but I have to wonder about the grip of the wiring on the cartridge pins. If it comes down to that, check those wire clips on the cartridge pins. But first do the homework, is my advice.