I actually think mine sound better with them off. There's more energy and clarity on the high end. Not a huge amount, but noticable. But, that said, it's very rare that I actually bother to remove them. They're magnetized, and very literally could not be easier to remove and/or replace. Let this be a testament to my lazyness.