If you're noticing micro scratches then you're going to need to learn to take care of your speakers as one would a concours winning car. The care is the same for both. Having both judged and won Porsche concours I know what it takes.
First you need to stop putting scratches in the finish. Probably all you're seeing is what you yourself put there. Two ways: using a poor quality micro fiber towel, and/or pressing hard enough to cause the dust to scratch. The best duster is an old 100% cotton T-shirt that has been washed a million times. Next best is premium quality micro-fiber like from Griot's Garage.
What you're seeing right now is so fine that if you try and remove it with a glaze you will find it only getting worse. Most advice you are likely to get is from guys who know even less about auto paint than audio. I've seen black paint so perfect your eyes wouldn't focus on it. There was nothing to focus on- it was more perfectly reflective than a mirror!
You are not going to do this, it is only going to make people freak, but what you do is get a random orbital, fine polishing pad and something like Griot's Machine 4. This works great, its the first thing I did to my used sub, but this is where we separate the men from the boys.
If you're too scared to go for perfect next best is Best of Show Wax. If your hairlines are as faint as I suspect they are this will fill and disappear them. This absolutely must be removed with the best micro-fiber cloth you can find, or the towel itself will put in even more scratches than you were trying to remove.
Then if you are smart you will see just how much work is really required to maintain your impossibly high standards and stop obsessing over every little dust mote. You may also come to understand the wisdom in the saying you don't own a black car, it owns you.