Am I out of my mind? #obsessed

No wonder tweaks of all kinds find there way into audio land. 

As others have said, get a quality microfiber cloth from the rag company for example.  The ones from South Korea are some of the best in my opinion.  Also, the ones from magicfiber.com are good and I use them on my glasses without any issues of scratching.  Lastly, dust the speakers before applying any polish/scratch hider or you may increase the chance of the actual dust particles adding to the scratches.   

b_limo:

I used a polish spec'd for fiberglass boat hulls on vintage plastic souvenir snowdomes and CD's with excellent results (forget the brand name).

It smelled/looked exactly like a CD polish that was in vogue 15 years ago, or so, but was 1/10th the cost.

Never tried it on paint.

DeKay

Thanks everyone! Much appreciate all the responses! 

Most likely anything you do to fix micro scratches is going to make the problem worse. The best coarse of action is limit the cleaning to twice a year and invest in protective, non abrasive covers. Then leave the speaker covered when not in use to prevent dust build up. I have a piano gloss wood finished speaker that I have owned now for over 20 years and they still look factory fresh. Although, if you look super close, a micro scratch might rear its ugly head but I don't worry about it.