Set the multimeter to the R x 1 resistance scale, or whatever its lowest resistance scale is. Touch the two test leads from the multimeter to each other, and adjust the meter so that it reads zero ohms. Then touch one lead of the meter to the ground shell of the rca connector at one end of the cable, and touch the other lead of the meter to the ground shell of the rca connector at the other end of the cable.
The reading should be close to zero ohms, and should certainly be well under 1 ohm.
While you are at it, make a similar measurement between the center pins of the two rca connectors. The reading might be slightly higher, because of the relatively narrow gauge of the inner conductor of the cable, but will most likely also be well under 1 ohm unless the cable is particularly long.
Regards,
-- Al