The closer the volume control is set to wide open the better off you are. If you are 12:00 to 1:00 then you have plenty of gain and it would be better if you could turn it up more, not less.
If you set the volume lower with your CD player then I would be more concerned about that.
If you set the volume lower with your CD player then I would be more concerned about that.