Does It Hurt....

What's hurting you more is using an AVR in a 2.1 system.  The compromises made in order to get all that processing and all those channels into one box doesn't leave much for fidelity.

Thanks for the responses!

All I really need is something that I can run my sound from my TV to my JBL bookshelf speakers without breaking the bank. 

@op - if that's the use for the amp, then you are fine as you are. In fact, chances are that your receiver's power amp sections share the same power supply. That being the case, if you are only loading two of the channels, those channels will probably perform the better for there not being other speakers connected.

yoyoyaya

Thanks for that response!