Volume demands for crossover change

NHT VT1A speakers: have a manual crossover switch, one for audio and one for video. Both settings have their appeal, but on video the volume setting is 35 while on audio i have to go up to 65!
This is on a parasound a21+ amp.
Why does this happen, and am i pushing the speakers and/or amp too hard on the audio setting?
The manual does show a 3db difference in sensitivity between the two settings. Every 3db drop in sensitivity requires twice as much amplifier power. I’m not sure exactly how that would manifest itself on your display, but chances are you’re fine as long as no distortion is heard.
It may seem contradictory, but it’s usually amps with not enough power that damage speakers. You have no such issue- you have an amp that puts out 300 wpc into 8 ohms, and 500 wpc into 4 ohms. Even if those specs are optimistic, you’ve got it covered. Again, if you don’t hear distortion, you are fine.