The reason bass drivers have gotten smaller is they are much more capable (longer throw) and faster (less overhang). Huge drives have inertia and are not nearly as articulate. Lots of folks have subwoofers… I suspect very often they are not adding to accuracy but over accentuating the lower bass.
I have gone to a number of homes and immediately turned the subs almost off… and the sound improved dramatically. I got rid of my sub woofers in my audio system a number of years ago. My speakers are flat to 28hz. They sound perfect, perfectly coherent. No integration issues. But then I don’t listen to hip hop.