At modest levels, you will only average a few watts. However, those peaks can get up there. If you crank the volume a little and average maybe 10-15 watts(or are using inefficient speakers), the peaks are in the 200+ range. If the amp can't deliver that, then it clips, which compresses the music. This is the primary reason for a big amp, to reproduce high level peaks cleanly, not so much for the steady state power.
As for the big power supplies, etc., it takes a large current supply to allow sustained low bass notes to be reproduced cleanly. Larger caps provide storage for the power supply to draw upon during heavy demands. If you listen at low levels, then this would be a moot point.
Since transformers are rated in VA (voltamps) which is actually watts (volts x amps) it is easy to see how a larger VA transformer can benefit heavy bass loads(since that is where most of the power is used.) The filters (power supply caps) help eliminate ripple (AC that slips through the diode bridge) but also store electrical energy, Try discharging one of those large 40,000uf caps by shorting the terminal to ground after the power has been off a while!
Unless your amp has some sort of mute circuit, the larger the power supply, the longer the amp will play after the power is off. This will attest to a big power supply.
This is a simplistic explanation but I hope you get the picture.
Power supplies have regulation which can be loose or tight. Tight power supplies have low headroom values where loose power supplies can supply substantial peaks. Most amps use loosely regulated power supplies. What this means is, how much current the supply can sustain before it runs out of juice or can it supply demand on a instant basis only.
This translates into amps that can supply higher wattage for a brief moment(peak) but can't sustain steady power. A good example of this is NAD which might rate an amp at 40 watts continuous but can deliver momentary power output of maybe 3 times that. It makes a cheaper amp sound more powerful than it really is.