I assume you mean by not in use as not playing a record but still connected and selected as the source. If this is the case, your table/cartridge is picking up subwoofer output and amplifying it somehow. Airborne or structural. Fit Nobsound springs under sub to decouple from floor. Or, if you disconnect the tonearm connection into the phono, and it’s still causing rumble from sub, then, yes something is amiss with the phono amp. Can you verify if this is the case? There is an unlikely possibility that components in the unit are microphonic. Given that you’ve experienced this with 2 units, it’s likely something else is going on unrelated to the phono amps.
I get the rumble when the turntable is not in use.