Conventionally, diffusion improves perceived ambiance while absorption improves imaging.
I suspect that the answer is somewhat dependent on the distance from the rear of the OB loudspeaker to the rear wall. Why, if the speaker is too close, then there is much more of a chance of the out of phase wave interfering with the sound coming off the front...so absorption should help.Here is a brief but interesting article:
http://www.gikacoustics.com/speaker-boundary-interference-response-sbir/I think that you can "simulate" the effect of diffusion by moving the panels out from the wall another 2-3' (not that you are going to leave them that way) which will then give you a different combination of direct sound, reflected sound and absorbed sound.