Double-faced tape on the feet, zip ties (in a range of 'attractive colors'....
I've a couple of items that suffer from the noted, but have been able to tuck them under or behind cables that keep them stable...
...and there's always Blu-Tak....
Gift wrap a brick....