I think it all depends on how much time you spend watching vs. listening. I set up a modest HT (Marantz Pre-Pro, Marantz 5 channel (use my McIntosh Integrated to power main speakers) Oppo 83SE BluRay), and find that I’m watching the news or sports and that’s about it. It’s complete overkill for what we do. We are moving and I’m selling off the HT components. In the new home, I will do a larger TV and a high quality sound bar. I will keep my 2 channel system completely separate from any video duties.
If you’re a true movie buff then a good HT system is definitely worth the time and effort. For me, it was not used enough in that capacity to justify keeping it at the new home.