I have two turntable suggestions, both of which already come with a pre mounted cartridge, and both of which I own. The first is the Music Hall MMF-7.3 with Ortofon 2M Bronze, the second is the Avid Ingenium plug & play with a unbadged Rega carbon.
The Music Hall is a very well designed turntable that sounds magnificent. Electronic speed change via the outboard motor, a carbon fiber 9" tonearm (9cc), acrylic platter driven by a round belt, threaded spindle with screw on record clamp, two plinth design, tip-toe feet, and includes both a dustcover and quality interconnects. Not to mention a beautiful walnut finish (available in gloss black for cheaper). The walnut version is about $1800.
The Avid plug and play Ingenium is a skeletal design that is built like a tank. It has an MDF platter driven by an external motor assembly. The tonearm is the Rega RB 110, with, as mentioned, an unbadged Rega carbon attached and aligned. Avid Is known to abide to the theory that the turntable itself is more important than the cartridge installed to achieve the best sound. In other words, you do not have to have an ultra expensive cartridge installed to achieve great sound. The Avid Ingenium uses a titanium ball bearing which rides on a sapphire bearing, the same as the more expensive Avid models. The turntable oozes quality build. It can be had for about $2100, but i got mine new for $1800.
As far as a phono stage, I also have two to recommend, two of which I also own. The first is the Tavish Design the Classic, the second is the Pro-ject tube box DS2. Both are tube preamps. I run NOS tubes in the Tavish with great results. The tube box DS2 has a front mounted knob to adjust moving coil load on the fly. The Tavish is about $800, the pro-ject is about $1000 with the wood side panels, otherwise about $800. So, for about $3000 total outlay, you can have a very nice analog set up.