A few suggestions from my own experience.
Yes, with the Lemo in place. I find the Soundsmith Counter-Intuitive device to be very useful for making small changes in VTF and azimuth with minimal change in the other. I use an AT cartridge. I find this brand to be excellent at mounting styli so that when the cartridge is level the azimuth is, at least, extremely close to optimal. Probably because of large-scale manufacture.
I judge the azimuth by ear. I've read enough about the Fozgometer to avoid it. Start with a level cartridge. Use a magnifying glass to view the stylus in the groove. With the CI you can make small adjustments. Use your ears for the best adjustment. And as VPI is fond of saying: Don't obsess.
Just my $.02.