I'm not sure these are freaky, but they're certainly exotic and VERY well recorded. Try Warren Smith's "Cats Are Stealing My $hit", Asante's "Ohene Kesee A Ebin" or "Bluiett's Barbeque Band" by Hamiet Bluiett. There's a lot more info and sound bytes on our website.
You might also track down anything by Foetus. I used to have the albums "Nail" and "Hole". It's a very odd mixture of sound effects (a chair dragging across a concrete floor, fingernails on a chalkboard, etc.) with a industrial-sounding drum machine and occational vocals.
I also heard a band recently called the Tards. I'm told the group is an revolving collective of musicians playing very rhythmic bluesy, industrial-rock-punk while pretending to be mentally-challenged. It's definitely weird and potentially offensive. They have a couple of releases available on Sympathy for the Record Industry records.