You don’t want to be clueless.
In terms of gear, all of it matters, from the phono cartridge to the phono stage, to the wires, the arm and the cartridge.
Then you have the issue of the current vinyl market- overinflated in my estimation, both in terms of price and grading.
New vinyl is largely digitally sourced; sure, you can get a different "voice" playing back over a turntable, but the real gold, to me, is old pressings.
And then you have to know what you are chasing and know how to buy-- basically understand that anything less than M- is a total crapshoot and if it is a scarce record, talk to the seller in advance.
You’ll need to know how to clean records effectively. (I won’t advocate one method, I’ve been down that rabbit hole many times).
Have I discouraged you yet?
There are still some bargains to be found. I buy the vast majority over the Internet, since I’m not real interested in the 298th reissue of a warhorse. (I’ve got more than enough classic rock, and thousands of classical records from back in the day that I have sadly ignored).
You need to educate yourself. Part of it is gear, but that can get sorted and upgraded. The question then becomes the source material.
I’ve found over the decades that my tastes have changed. Every once in a while I’ll pull out something that hasn’t been played for 30 years (but clean, with a nice old third party inner) and fire it up.
Getting "into" LPs requires some basic competence in set up, associated equipment and ultimately depends on how deep and broad your listening tastes are.
Good luck,
PS: FWIW, I would not go into this medium at this point. But more power to ya.