Recommendations for a modestly priced analog system

As millercarbon recommends, focus on a phono stage as much as the table. One can make or break the other. Avoid tables such as those with a built in phono stage or USB capability. Those features just run the price up and do not add to the quality and performance.
Simply....table, cartridge, arm, and phono stage, and solid support. For your budget you should be able to get a pretty decent rig. Then the adventure starts....all the good vinyl you can get your hands on.

Lot's of good recommendations already given.  

You can find a very nice used VPI TT in your price range and leave enough room for a good phono stage and cartridge.  Lots of deals on VPI's that have upgraded 3d tonearms and a good cartridge such as the ortofon black.  You should be able to find a package in the $3k-$4k range and that leaves you plenty for a decent phono preamp.  

Many good choices out there for a phono preamp but it depends on your preamp.  I would pay attention to input / output impedance match up.  MillerCarbon recommends an outstanding phono stage with the Herron but make sure your preamp can match up well with the high output impedance of a tube phono stage.  Unless unusually low such as the case with my Bryston BP26 preamp you should be fine.   If you want something different the Parasound JC3 also is a good choice IMO. 

Good luck on your journey.  Your budgeting enough to put together something very nice.  Enjoy!   

Music hall 9.3 with the eroica lx, preferably the walnut version. A highly regarded turntable and a steal at $2600.....run it through a Tubed phono stage from tavish and then roll some nos tubes in...nice. 

Rega P10. IMO you need to spend 2x to better it in all aspects.

Hello chungjh! I am running a VPI HW-19 MKIII with Jelco TK-950S (recently purchased, used to have 550S and 750) and Hana SL. As a gift to myself, I am looking at the Benz Micro Glider SM. (User kron sells it among other cartridges at a discount.) My phono stage is a C-J EF-1 with premium capacitor upgrades in a few places. I am quite pleased with my set-up which in Canadian dollars should be around 4.5 - 5K at present used prices. I believe that's very good price-performance wise. 

My suggestion would be a used, even vintage, turntable as long as it is sound mechanically and functionally. Some turntables, as long as they're taken care of are indestructible. The VPI HW-19 MKIV is a good contender I think, based on my experience of the MKIII. And of course you've got some other suggestions already.

But buy a new tonearm for peace of mind; unless you know the person you're buying from, it is a risk to just take people's words on precision mechanical instruments like tonearms. If you should buy a used tonearm, have someone take a look into the unit. Same with cartridges. 

And I agree that you'll have money to spare to get accessories, records and a good cleaning system. 

Happy hunting!