Is There A Device For Home Use That Can Measure How Low The Bass In My Speakers Is?

Any suggestions if a CD player is not available?

An SPL meter measures loudness in the units of dB. Is there a similar handheld device which measures frequency in Hz?

You don't need a CD player or any test CDs or files. To measure how low the Hertz you need a calibrated test microphone and software to use it. It can also show you how high the SPL before to much distortion. The OP isn't asking how loud his bass goes but how low in frequency.

Usually you have a source with the Hertz that you choose to test and use the dB as the test result.  There are cell phone and tablet apps to do this measuring.  Improved results can be had if a separate microphone is acquired.

The Velodyne SMS -1

Its a combo room analyzer, X-over and EQ. It’s designed to produce bass sweeps that you can see on a video monitor The idea is to use the X-over and EQ sections to get a smooth handoff to a subwoofer, but the room analyzer will show only the bass response of your main speaker (below 200 hz) if there’s no subwoofer in the system

Pick up a copy of the Stereophile Test CD.  Then download a audio spectrum analyzer to your phone.  Basic "Spectroid" will give you a good idea how low your speaker will produce audible bass.