I think it has to do with the natural tone from wood, why is it most musical instrument are made from wood and sound so great.
Wood used for musical instruments, and wood used for speaker enclosures serve a completely different purpose.
With musical instruments, the wood is supposed to resonate and become part of the sound.
Speaker enclosures, no matter what they are made of, are supposed to be as acoustically inert as possible.
Scientists have spent centuries trying to reproduce the signature sound the wood of a Stradivarius violin makes.
Scientist and engineers have spent decades trying to get speaker enclosures to not have any sound.
Make a violin out of, say, constrained layer damped wood, and it would sound horrible. Make a speaker out of highly resonant wood that is poorly damped, and it would sound horrible.