Good question.
You bet impedance is an issue, actually the issue when pairing a pre and an amp. Impedance matching - or mismatching - between the pre output and amp input is the key to a successful pairing or two boxes that just aren't happy together... Call it synergy =)
A great deal can be found on the subject by those both more technical and erudite then I am - all I can contribute is that its great when it happens and noticeably not great when it doesn't. T'aint no subtle or illusory thing.