Okay….couple thoughts. The move closer to the wall is giving you a bit of gain which is common. You get about 3dB from the wall. Move into the corner and it will jump to about 6dB. But you will lose refinement.
I am not seeing good measurements of those speakers but I do believe Harbeth s are best when toed in toward the seating position. What you can’t assume is that you are getting a softer, less edgy sound because you are off axis. I have a set of speakers that I make where they absolutely brightest when they are toed in about 10%. When you toe them into the seating position they border on dark. I am not saying it will be best fully toed but you should try it.
you have a tough room from a setup perspective. You can do a few things. You can experiment with treatments both to soften the treble and to enhance the bass. What would be most interesting would be to get a full range microphone and measure at your seating position the frequency response. This will let you see what the room is doing to the frequency response.
finally, there is nothing obviously causing the edginess you are experiencing. I do run into this when there is a mismatch in terms of gain and impedance between components. Too little or too much gain can or too weak or too strong of a signal from any component leads to that hard edginess.
might want to try a preamp with adjustable inputs and outputs.