Check out The Needle Doctor. He's got lots of inexpensive gear and it's a good place to start. A friend of mine started there with a Bellari Phono stage and Music Hall table/arm/cartridge combo and was very pleased with the sound.
You should get enough of an idea whether you really want to get back into vinyl without spending a lot of money and if you do, you can always slowly upgrade to a level you're happy with. Be careful though, it could get expensive. My friend has gone through a few tables and arms, at least a half dozen cartridges and went from zero albums to over 2000 and still counting. Actually, he liked analong so much he got into reel-to-reel and I think he's now up to six decks not to mention many, many tapes.
Happy hunting!