Yes - this suggests that in your SUT the chassis is not grounded unless you connect a wire to the preamp from the earth post of the SUT. If the SUT chassis is not grounded then all the soldered connections inside are unshielded and prone to RF and this is why the noise reduces further when you connect the SUT ground to the preamp.