It will definitely affect sound quality if the power cord falls out.
Its not the outside of the plug but what's inside that's the problem. If the terminals inside the plug grip the pins on the component with enough tension the plug will not fall out no matter how sloppy the fit. Conversely, no matter how much electrical tape you wrap or how tight it stays in nothing like that will address the real problem of the electrical contacts being this weak.
So you have a piece of crap power cord. Well there are a lot of them out there. Live and learn. The only real fix is replace the plug on the end of the cord. Or you could open it up and try bending the mating parts inside enough to get a better grip.