This is why there is home theater and two channel audio for music. Completely different experiences.
While it is true live concert hall venues have reflections from the sides and behind… the degradation of signal by incorporating all those extra channels are generally not worth it. So two channel audio is by far the best for music… concerts.
Movies… bullets flying behind… 5 or more channels sound great. You are distracted by the video so you don’t knotice the poorer sound quality.
I have a separate 2 channel audio and home theater… you can see them under my UserID.