It is vital to clean your stylus at least after every listening session.
I know many who clean theirs after every album.....I certainly need to do this with my London Decca Reference which picks up crud from the grooves like some Atlantic bottom feeder.
Unfortunately just brushing the stylus does not render it pristine and if you inspect it under a 20x or 30x lupe....you will see the encrustations fairly clearly. That's why many resort to Magic Eraser and ZeroDust to perfect the process.
Happy listening...🎶🤗