Help Me Build a Vinyl System

Go for it. Get a VPI.

Here's my recent experience - I started from relatively zero and now have a fantastic vinyl playback system and decent record collection for under $5k (used VPI Scoutmaster, Soundsmith Zephyr, Sutherland Ph3D.)

Vinyl's gotten me both amazing sound quality and tons of fun.

You can get mixed lots of 100 classical LPs here on Audiogon for about $2/record, $5 - 10 for fancy labels. Mixed bag, but part of the fun is exploring what's there. I'd never pay $20 each for 4 different recordings on CD of the same piece. But, its easy and great on vinyl. On the other hand, the high quality reissues - Music Matters Jazz, Acoustic Sounds, Mosaic, etc - are simply amazing quality, though expensive ($50 each)

Let's forget your statement "...to start with"
You gonna get it right once and for ever!
1) : Lenco L75 (less than $200 ebay) + (about $350 ebay) plinth with removable armboard (jec965)
2) : Zeta tonearm ($900 Audiogon)
3) : Denon DL-103R Panzerholz uwe body soundsmith level 1 ($375 Audiogon)
4) : Einstein TT CHOISE phonostage ($2650 Audiogon)

Ps : You must be very quick to grab 2) & 3) ASAP !

Lots of good sound advice.. Rauliruegas spelled it out perfectly...I started in the same position as you are now.
I have spent approx 15K on my vinyl system and lps in just over a year. My budget was 5K...good luck!
I hate cleaning records too!

Correction: Jazdoc had it spot on with help from Raul.

I can't offer much equipment advice because I've just gotten back after many years away but maybe you can learn from my experience. Two days ago I went to a Brandi Carlile show with my daughter. Vinyl gets me closer to that live sound than digital. Period. I also have an excellent system with an $8k amp and $5k DAC but vinyl is different. In addition, there is a huge amount of great music that never made it to CD that I can now explore- that's why I took the plunge. Given your current system, I advise you to avoid the very inexpensive gear unless someone knowledgeable vouches for the sound quality. I wasted lots of money going from a $300 tt to my current investment. Unless you're doing it just to explore- go for a setup that you can keep long-term. You can't lose with a VPI Scout or Scoutmaster or a SOTA. They're relatively less expensive given their quality and the companies are local and easy to deal with. It was a good deal of work dealing with MM/MC, step-up transformers, azimuth, cartridge loading, cleaning fluids and systems, etc. so a complete package with tt, arm and cartridge it might give you a starting point from which to learn more. Going piece by piece and mathching components sounds scary. I wouldn't waste a dealer's time and then buy used but you can hear lots of analog at shows. At the '07 THE show in New York, everyone who was not selling digital was showing off their equipment with vinyl-that told me alot! It's work but this is a hobby. Enjoy!