Yes, an amp with a higher input impedance would be preferable. There is a rule of thumb that the input impedance of a component should be at least 10 x the output impedance of its upstream component. I'm about 38 years removed from my last physics class, so I defer to someone else to provide you with the math. Failure to observe the 10 x rule can result in attenuation of the signal at frequency extremes.
Since I like to use passives, I tend to stick with amps that have ~ 50-100 K ohms where impedance mismatch is not an issue. Then the only consideration is making sure you have sufficient gain.