Checking after each side is played is over-doing it IMO. I check when I turn the system on, while warming up: check, typically ok, or brush a speck of dust, or maybe if I see something more stylus cleaning fluid with it's cap brush. Or, you hear something, sure enough, a bit of ...... hanging on the stylus
IF you are finding anything more that occassional dust, frequently finding gunk on your stylus, then it is digging that out of dirty grooves, you need to do a better job cleaning them.
I no longer use a brush to clean the LP, it pushes dust down into the grooves I think. I use a large lint free eyeglass cloth, a manual spin, a light wipe of any surface dust center to outer edge (I have forced air hvac, airborne dust)
My old LPs from high school/college days were filthy, noisy, gunk on the stylus frequently. I manually scrub the crap out of them with infant scalp brush, the advanced stylus gets deeper in the cleaned grooves than the elliptical I had in those days, they sound surprisingly listenable again. Setup for perfect imaging, whistle while I work, batches of 10