The answer is pretty much covered by the other responses here... the loudspeaker rating is how much power it will tolerate, the amplifier rating is how much power it is able to deliver. So you need an amplifier that can deliver the sound levels you want plus a bit of headroom to avoid excessive distortion / clipping.
One advantage of using a lower powered amplifier is that you don't need to attenuate the signal as much... potentiometers tend to perform progressively worse the more the volume is turned down, there's more information on that here if anyone's interested.
One advantage of using a lower powered amplifier is that you don't need to attenuate the signal as much... potentiometers tend to perform progressively worse the more the volume is turned down, there's more information on that here if anyone's interested.