I have built gear and cables using both and one fact remains.....there is no answer to your question that is the final truth for all. It depends on your gear, musical tastes (type of music), sound preference, system synergy and on and on.....
I have found that if you're going to use silver, then go for solid core and go for as heavy of a guage as you can afford/find. The right silver, solid core, and thicker than 24 gauge can sound very good indeed.
Silver does sound different and has proven to be more resolving in each and every case I have used it. Great solid core copper is warmer sounding and more rounded if you will. This is also something I have witnessed time and time again. A mixture of the two throughout my system has yielded the best results. This has taken me several years and lots of experimenting however. The only way to learn for yourself is to try some. No other way I am afraid to say.
If you listen to mellow jazz and calm voice that is well recorded, then silver may be just the ticket. It may, but there are many other variables which folks have already stated. I have found that the recording quality plays a big role on which wire I prefer. Poor recordings suffer more on silver in my experience. If your musical tastes force you to listen to many mediocre to poor recordings, then copper may be a better choice for you.