Buy the VPI and stick with the Memorial arm. VPI unipivot is excellent. I have one on my Classic 3 and would not trade it for a gimballed arm. (I would like to try the new 3D printed arm, however!)
Buy the best cartridge you can afford. It should match the tone arm. Lyra and Dynavector are good choices, but so are many others. I have a Dynavector TKR and love it. Very balanced, very dynamic. But as with any low output MC, be sure to get a phono stage with enough gain. Your preamp will do fine for now.
Vinyl records provide joy beyond the music. There is tactile satisfaction and the zen of ceremony in playing them. As others have stated, a record in pristine condition will have no discernible background noise and very few tics and pops. If you collect old classics that may be scratched or otherwise abused, buy a Sugar Cube and they will sound as clean as a CD. An occasional tic or pop from static electricity is no more annoying than the sound of a zipper at a rock concert.