Is it possible for an audiophile to be "just too finicky"? This is a question that may need its own thread. Or not...
As a former professional millwright, amateur mechanic (auto and motorcycle) and current computer geek who has encountered stuck and mauled fasteners of many sizes and types I see a number of good suggestions above. All of them work, but knowing which to use and when is the maddening thing. As a starting point, common sense suggests keeping the tool size relative to that of the job.
Still, my preference was always the chisel and big hammer method. Either the job got done or the offending part needed replacement. Hmmm. "Honey, I need to buy a new CDP, this one is beyond repair now..."
Cutting torches are, btw, a godsend.