I would start with the best table you can afford. Usually you can get the arm in a package deal. Putting on an arm of your choice is something you might do once you have more experience with the gear.
Cartridges are small, fragile things, and unfortunately they do not get more robust as the prices go up. They also need to be retipped or replaced every few years, and even replaceable styli on moving magnets can cost half the initial cartridge outlay. So don't forget to figure in these replacement costs and your pain level for breakage.
A good phono preamp can make a huge difference, but doesn't have to be expensive. It's also the easiest analog component to change when you're looking for a different sound.
Cartridges are small, fragile things, and unfortunately they do not get more robust as the prices go up. They also need to be retipped or replaced every few years, and even replaceable styli on moving magnets can cost half the initial cartridge outlay. So don't forget to figure in these replacement costs and your pain level for breakage.
A good phono preamp can make a huge difference, but doesn't have to be expensive. It's also the easiest analog component to change when you're looking for a different sound.