That would be a mistake. When seated at your listening position the front wall is in front of you and the rear or back wall is the one in back of you.
There is much more to imaging than lateral position, there is image size, location in depth in the sound field and the third dimension which is the sense that the instrument is a 3 dimensional object in space. Early reflections will disturb all of them even if lateral location is not affected. As far as stability of the image is concerned, especially with point source speakers, The image is extremally fragile when out of the listening position even by a few inches. 30 degrees or more off axis you can even lose the far speaker completely. Because lose of volume with distance is much less severe with line sources they create a more stable image and you never lose the far speaker of axis. The image is still perfect only at the listening position. This is why Line Arrays are used exclusively at large concerts. We were at the Arctic Monkeys concert at Red Rocks last night and even the subwoofers were linear arrays just outside of the main Linear Arrays.