Not only do I use the Invert Phase button on every disc, I use it at the beginning of every song. Even on the same album some songs require it, some don't. I can tell usually within a few seconds if it's needed or not.
I can't imagine life without it now that I've heard the difference it makes.