These words are from the verbs rifler, to spoil or strip, and raffler, to carry off. The phrase referred to the plundering of the bodies of the dead on the battlefield and the carrying off of the booty. ... The phrase was abbreviated to riff-raff and can be found in Gregory's Chronicle of London of about 1470.
Dead bodies are Not my thing....Noooo.