Am I out of my mind? #obsessed

Looking at black cars or piano black lacquer the wrong way can cause swirls or marring.  The speakers are probably a polyurethane finish and I would not try to remove the swirls with an aggressive polish as you may dull the finish.  If you can't live with it, there are glazes, like Imperial Hand Glaze, which are specifically made to hide and fill the slight imperfections.  Just make sure you work with a microfiber cloth, move in straight lines and be very gentle.  This should help to hide the imperfections to some degree.  

@chayro gotcha. Thanks. I’ll be careful.

Stay at least a few feet away from your speakers and/or get some therapy.  You may very well end up doing more harm than good succumbing to OCD, then you’ll really be unhappy.  If you don’t listen to your speakers from less than three feet away then don’t look at them that way either and you’ll be much happier.  Life’s too short. 

If you're noticing micro scratches then you're going to need to learn to take care of your speakers as one would a concours winning car. The care is the same for both. Having both judged and won Porsche concours I know what it takes.  

First you need to stop putting scratches in the finish. Probably all you're seeing is what you yourself put there. Two ways: using a poor quality micro fiber towel, and/or pressing hard enough to cause the dust to scratch. The best duster is an old 100% cotton T-shirt that has been washed a million times. Next best is premium quality micro-fiber like from Griot's Garage. 

What you're seeing right now is so fine that if you try and remove it with a glaze you will find it only getting worse. Most advice you are likely to get is from guys who know even less about auto paint than audio. I've seen black paint so perfect your eyes wouldn't focus on it. There was nothing to focus on- it was more perfectly reflective than a mirror! 

You are not going to do this, it is only going to make people freak, but what you do is get a random orbital, fine polishing pad and something like Griot's Machine 4. This works great, its the first thing I did to my used sub, but this is where we separate the men from the boys. 

If you're too scared to go for perfect next best is Best of Show Wax. If your hairlines are as faint as I suspect they are this will fill and disappear them. This absolutely must be removed with the best micro-fiber cloth you can find, or the towel itself will put in even more scratches than you were trying to remove. 

Then if you are smart you will see just how much work is really required to maintain your impossibly high standards and stop obsessing over every little dust mote. You may also come to understand the wisdom in the saying you don't own a black car, it owns you.

My GE Triton Reference Speakers are over 3 years old and the piano black lacquer finish is still perfect.  Dusting with just a microfiber cloth will get you scratches.  I talked to Sandy Gross who was the owner of GE and he told me to lightly mist the speaker with spray bottle of spring water and dry with a clean microfiber cloth going in one direction ONLY. I do not have any scratches or swirl marks anywhere on my speakers by following Sandys directions.