The psychological factor

What preamp are you using?

With my Benchmark HPA4 preamp and AHB2 amp set to low gain setting (the defaults) I really need to move the volume control to the far right to get high volume, just the way I like it.

This combo also sounds great at low volume, which is unusual for me with past gear. Sometimes I listen at low volume late at night even though I have the amazing Meze Empy headphones which I can plug into the HPA4. You hear everything even at low volume, just quieter.

As indicated above, preamp is Conrad-Johnson.

Look, you turn it up as loud as you like. Who cares about the position of the volume control. If you can not get to the volume you want then you need a more powerful amp, one with a higher input sensitivity or a preamp with more output. If that does not do it throw the whole mess away and start over but be prepared to spend at least three times the money. 

The volume control on every system has a sweet spot or sweet zone where the music in your room to your ears sounds best. It can change slightly from recording to recording or even from genre to genre. The numbers on the dial are merely reference point so you can find that place again and are otherwise pretty meaningless.

rvpiano, I have AHB2 and use it at the lowest gain settings (Pro-level) as recommended by Benchmark (with DAC3 HGC). The whole idea is to move as much gain as possible to preamp (quieter environment) from power amp (noisier environment), not to mention less (percentage wise) electrical noise pickup on ICs between the two.   As for psychological factor - I like my max power to be around 2 O'Clock to be sure it will cover even very quiet records.  3 O'Clock makes me feel uneasy.