jon - it could be anything in the entire chain from source to speakers. Time for classic, systematic troubleshooting.
The likelihood of XO problems is very small, and XO problems tend to exhibit frequency-related / balance problems. A rubbing voice coil is possible. Feel free to PM me for troubleshooting advice.