James Taylor singing "Overcoat" on Jerry Douglas' "Look Out For Hope" is both sad and haunting.
Dory Previn (anybody remember her?) "Doppleganger" This one really gave me the willies every time a buddy played it during my college "daze"
I think "Yulunga" from Dead Can Dance "Into the Labyrinth" fits this category too.