Chashmal,
When "mistracking noises" ("MN's") are heard then actual mistracking, vinyl damage and phono stage clipping are all possible culprits. The next step is to diagnose.
If MN's occur on multiple LP's, both old and new, we can probably eliminate vinyl damage.
Next question, are the MN's in one channel or both?
If the MN's are all (or nearly all) in one channel, you probably have mistracking. Try tweaking antiskating. Increase AS to eliminate R channel MN's, reduce AS to eliminate L channel MN's. If this doesn't affect the MN's, keep reading...
If the MN's occur about equally in both channels or if AS adjustment has no effect, try increasing VTF in .1g increments (until you reach the maximum VTF for your cartridge). If this materially reduces/eliminates the MN's you've found your (a) culprit. Try playing your rig just barely above the VTF needed to prevent MN's. Many cartridges perform very well at that point, which balances the downforce needed to prevent vinyl damage against freedom from unnecessary or excessive cantilever damping.
If none of the above eliminates the MN's, try a different (better) phono stage. Inexpensive phono stages often clip high amplitude signals at certain problematic (to them) frequencies. This can sound so close to mistracking that even expert ears can't tell the difference.
There's also the slow play test to be doubly sure you're not hearing damaged vinyl. "Play" a suspect passage by spinning the platter by hand at VERY SLOWWWWWWWWWW RPM's. The music should sound like a low frequency growl. Any vinyl damage will be much quicker and higher in pitch, very noticeably different from the music. If you hear that the record is to blame and there's no cure. New vinyl can have flaws that this test will reveal, as can old, damaged vinyl.
Oh, you wanted the short answer? Yes, try more VTF! Why not?
:-)