Try blu-tak. It's commonly available in the UK for just a couple of bucks, and in the US it's sold by audio dealers to hold speakers to stands. They usually mark it up to about ... er $20 (snigger).
Seriously, it might work, and it doesn't leave any residue.
You might also try sticky tape or masking tape.