The arguments are dissimilar.
This is not about whether a digital format produces a perfect reproduction of an analog source or otherwise.
This is about whether the USB data transfer protocol is bit perfect as long as the interface is spec compliant- including the transmitter and receiver.
The answer to the latter question is yes, it is.
The answer to the former question is far more complex.
There is some possibility that the USB can introduce noise through the ground connection. The USB receiver can be designed to eliminate the possibility of ground loops. However, sometimes the problem does occur.
By the way, to put this in context, my system is tri-amped with a sub woofer and a pair of slightly modified ML Montis, The electrostatic panels are driven by one of the following- Rogue M180s, Hypex Ncore 400s or a Benchmark AHB2, depending on my whim. The non electrostatic units are all driven by DSP equalised class D amps.
The preamp is a modified Hovland HP100 or a home made phono amp driving a digital ADC/DAC- the RME ADI-2 PRO FS. My cables are all home made (except for the USB ;-))
My cartridge is a Miyajima Madake. I also have many 15IPS 1/4" 2 track tapes- safety masters or similar- that I play on a Otari MX50.
I have digitized many LPs/tapes and I play them back with the RME device using a USB connection.