Sorry, but things are never this simple.
Common-mode noise on the USB interface and cable can easily induce noise in the receiving system, resulting in more jitter. This does happen, because USB interfaces sound better with common-mode noise fixes like filters and galvanic isolation. Ground-loop noise will further exacerbate this. This effect happens even though there is some common-mode noise rejection by the differential signaling on the USB cable. These receivers are never perfect. Also, the edge-rates of the USB signals can affect the receivers slew-rate, which can impact jitter.
I am only talking about jitter, not data corruption here.
Steve N.
Empirical Audio