If someone says yes, there will always be those who will say no or it depends. However, it appears that people who are not too lazy and have good hearing say yes in this case. By the way, Redgum has now an option of single volume control, but they warn on their website that it will sound a little worse.
Also, moving the listening position left or right will not always help and can actually cause even more soundstage distortion. Depends on room and recording, I experimented with the amp I had before with single control.
The point is that there is no way around. At least none that I can see.