True, dat.
EG, a electrolytic with a much higher frequency response, or lower impedance into higher frequencies...might make an amplifier oscillate out of control, due to the feedback and loop gain being set too close to the limit and part of said limits unintentionally relying on the original capacitor’s limits. It can be done. It happens more often than one thinks.
Willy nilly cap replacement by people without the understanding of the circuit, can result in circuit failure. Or over-stressing that can kill the circuit far sooner than the original design and build intended.
Let’s try a hopefully humorous analogy.
Most solid state audio circuits turn on, when that power switch is hit...like they were punched in the head with a ludicrously high speed truck. Hit the power switch and everything in the box goes *BANG!* (Ok, we’re all awake now, pedaling our little bikes!) Somehow they survive it. Robust little things, generally speaking.
If you get in there and make capacitor value and capacitor quality changes, it’s like adding in bigger and faster truck change-outs... to the circuits which were originally being punched in the head by big and fast trucks. This is generally not a good idea.