I tend to agree. Provided the player has a solid, stable transport mechanism and you're happy with the remote control and functionality then you're set. That's why a lot of people look for older players like the Pioneer Elite models that don't sound great by today's standards from their analog outputs but have the famous "stable platter" transport as well as rock-solid build quality. But I've also used $50 DVD players that sounded as good (through the DAC) as much more expensive, dedicated CD players. Your mileage may vary.
That said, what's your budget? If you're planning to spend $1000 or $1500 total for example I have to wonder why you would want to go through the hassle and complication of two boxes, two power cords and one digital interconnect when $1000-$1500 players like the Rega Apollo and Cambridge Audio Azur 840 provide digital playback that's within shouting distance of "as good as it gets."