If you're getting pops and clicks on your new vinyl as well, I think it might be static, not dirt. Do you live in a dry environment or have air conditioning? An inexpensive carbon fiber record brush like the Audioquest, Recotron, or Decca (they all look the same) is available from Music Direct, AA, Acoustic Sounds, etc.
They're very effective, but here's a little tip to improve their performance: with the record spinning on the TT, lick the tip of both index fingers. Touch one finger to the preamp cabinet or some other ground potential (like a metal TT shelf bolted into a masonry wall!) and the other touching the metal handle of the brush as you swipe the record. This will provide enough ground "drain" to get rid of the static. If you don't feel comfortable licking your fingers before each record (curious guests want to know!) then actually ground the brush to the ground lug on the back of the phono preamp or preamp, with a length of flexible wire or keychain.
.
They're very effective, but here's a little tip to improve their performance: with the record spinning on the TT, lick the tip of both index fingers. Touch one finger to the preamp cabinet or some other ground potential (like a metal TT shelf bolted into a masonry wall!) and the other touching the metal handle of the brush as you swipe the record. This will provide enough ground "drain" to get rid of the static. If you don't feel comfortable licking your fingers before each record (curious guests want to know!) then actually ground the brush to the ground lug on the back of the phono preamp or preamp, with a length of flexible wire or keychain.
.