As others have said, get one device for home theater and another for two channel stereo. The amplification in most AVR units is not very good. Your best bet is to get a "processor" (no amplification) and a two channel preamp that has home theater bypass and use a separate amp(s) for your main speakers. You could get an AVR that has a preamp option that allows you to bypass the amps in the AVR for your main speakers and use the AVR to power your surround speakers.
This allows you to listen to two channel music without having any of the home theater components in the chain and to share your amp(s) with the home theater processer when using it.