Actually the suggestion of taking the driver out and putting it outside in sunlight is not bad, it would help break down the urine, albeit it might also help break down the cone. Ozone generator similar idea but it's an open question about how good of an idea that is in your house.
But if it were my speaker, I'd replace the driver. The thought would drive me nuts regardless of the actual impact or lack thereof.