A $2k budget as previously suggested for table, arm, and cartridge is very reasonable. Add $1000 - $1500 for a phono stage and up to another $500 for cleaning supplies and you should be good to go. I wouldn't hesitate to buy a table used if available for local pick-up, has original packing materials, or is otherwise being sold by someone who is an expert at packing such an item. Same for the tonearm and phono stage. Personally, I'd never buy a used cartridge.
As for record cleaning you could probably start small and as you grow into vinyl then commit to something like a VPI machine. Many people are steam cleaning records now. There is lots of information here on record cleaning that can keep you occupied for a while.
As for record cleaning you could probably start small and as you grow into vinyl then commit to something like a VPI machine. Many people are steam cleaning records now. There is lots of information here on record cleaning that can keep you occupied for a while.