To Plug Power Amps Direct in to Wall or Not ??

"I do notice better performance on the power amps plugged directly into the wall."

You've probably just answered your own question. Maximum performance, in my opinion, trumps the minor equipment safety concerns.

"Or am I being too much of a worry wart."

I'd say that it's self-defeating to purchase high end gear for big bucks and then compromise its performance with a surge protector or something. You MAY want to consider one of the supposedly "non-current limiting" big boys like Running Springs Audio or some of the others. I think those offer surge protection.

Also, the NBS website provides an interesting perspective on this issue (I don't sell NBS or work for them or any other power conditioner company):
What the people at NBS have to say

I plug mine directly into each amp's dedicated line. Surges etc. are a conern, however there are few "protective" systems made that will not impact your amp's performance. A friend and I have tried various products, which at first we think made a marked improvement, but after listening to the system with protection, then switching back to a direct connection, we've always found the direct is better. Then a few months latter, we'll try another scheme to improve the sound and have repeated our findings. There are places in cities where the electrical lines indeed sound trashy because of to high a load, noisy transformers, etc, and for these areas I'm sure the surge protection schemes may improve the electricity so much that filtered sounds better even with the current limiting factors these devices seem to impose. If you live in the heart of a city with lots of industry and heating cooling needs, you may want the protection of line filters/regenerators. If you live in the suburbs you may have similar findings to mine.
If you listen late at night, you'll almost always have better sound.

Good listening,
Sgr

My Pass dealer told me to do so (right into the wall), as recommended by Pass. Sure enough, all surge protectors or AC filters I tried made my X350 sound compressed. I have discovered the same is true with my Edge NL12, which is now also right into the wall. (My source components, however, benefitted from being plugged into my Hydra 8.)
I have never had a problem in my house with this arrangement.

It's perfectly safe to plug the amps straight into the wall, especially on non-shared circuits. I prefer that approach to most "power conditioners" that tend to screw up the detail or the dynamics or both. However...

I have discovered that an IsoClean power filter can improve the sound even on a dedicated circuit. They're just filters though, so they don't do regeneration or surge protection. However, given the quality of the power in most of North America these days I wouldn't worry about the really bad stuff too much. Unplug the system during wind or electrical storms and you should be OK.