I’ll stay out of the gear recommendations part and make a few observations as a long time vinyl lover.
If you are committed to the format, your records will eventually exceed the value of the phono front end, which includes turntable/arm/cartridge and phono stage with associated wiring.
There are some pretty good deals on new vinyl being produced through Blue Note/Tone Poet and the Verve/uMe series from Analogue Productions/Acoustic Sounds. None of those are terribly expensive new and their QC is decent (though with vinyl, even the fancy audiophile stuff, QC is almost always an issue). These are jazz records, not necessarily "out there" stuff, but not "lite" either.
Most new reissues of classic rock warhorses are going to be derived from a digital file which isn’t per se bad but you can hear differences between different pressings and once you dig into the "classic rock" field, you’ll see that there are multiple versions of some records that are highly regarded-- sometimes there is no "best" but different strengths and weaknesses. Older threads on the Hoffman forum where comparisons are made can be valuable (a post just saying "oh, I got this copy, it sounds great" is meaningless).
With used records or old copies (even if they purport to be sealed/dead inventory), you’ll have condition issues- these days grading is inflated as are prices on a lot of the more desirable records.
You will need a way to effectively clean the records. That does not have to be a huge investment, but takes some time to get an effective method that does not leave residue and doesn’t involve so much time or effort that it robs you of enjoyment.
Flattening is a hit or miss proposition- both old and new records can be warped.
I had enough records to justify the outlay for a substantial record flattener and it has been a lifesaver for me--since many of these records are long out of print, private label and very hard to find. Not cost-justified for most people- there are a few services that will do it for a fee.
Guess I’m just offering you a reality check on what "getting into vinyl" means.
I’m a believer in buying the best you can afford simply because, with care and maintenance, most of this stuff, except for the cartridges, can last a lifetime.
There’s lots of info on "bargain cartridges" that perform well. Trying to hear differences between turntables, arms and cartridges is practically impossible.
We did a comparison at @Albert Porter’s last month between two top dog cartridges- each mounted on an identical arm on the same table. Albert was able to switch between them, compensating for gain differences. The differences were discernible.
There’s a lot to dig into, some basic skills you’ll probably want to acquire in terms of set up and despite the fact that you probably can’t do meaningful comparisons in a shop, it might pay to get a little seat time and hands-on experience with what you are considering. Welcome to the rabbit hole. It is deep (though it doesn’t have to be), has some twists (beware of marketing hype and reviews disguised as advertorials) and can involve the study of history, how records are made, lots of minutiae, like decoding deadwax to understand which pressing you have to hand and other stuff that may seem like heavy nerdsville or an opportunity for exploration, depending on your interest.
Good luck- one of the best things about vinyl for me is chasing down old obscure records that I like listening to- not for collectability but for enjoyment. And the "hunt" is part of the process, once you know what you are looking for.
Bill Hart