"But since human hearing is not flat, a flat response could yield all kinds of lows and highs a particular listener does not want."
So if you roll off the highs and your ear is rolling them off further, you take too much away. Natural sound is not produced "rolled off". It goes from infrasonic to ultrasonic.