Thanks, Mariasplunge.
I personally don't have a huge music library yet, but I'm trying to set myself up for success by starting on the right foot. Right now I have the records that I've cleaned so far organized alphabetically by artist, then alphabetically by album. The records that still need to be cleaned (hundreds and hundreds...) are loosely organized by importance of getting cleaned. I constantly have an "on deck" section, and I'll pick whatever strikes my mood from that pile to clean.
CDs are alphabetical by artist, and CDs with more than one artist are filed by the artist that I like more.
-Dusty