The volume (power) level and the impedance of the speaker are different. For a given impedance regardless of the power, if the impedance is raised the distortion will be lower. So ideally the speaker would be of the efficiency and impedance that you can take advantage of both.
Very appreciative of the clarification @atmasphere
One last question on this if I may. You mentioned in your 12:16pm post "...all other things being equal". Am I correct that you are also speaking of the *sound pressure level*? I ask because if so, again it would seem to me that higher speakers impedance (say 16 ohm instead of 8) would mean that one would need to raise the volume/power to achieve the same SPL, and hence in so doing could increase distortion if the amp is not operating in its "comfort zone".
Thanks again, atmasphere.