Larger drivers being slower is a misnomer. Often smallish drivers are wrongly claimed to image better, sound quicker, etc. It's mostly attempted justification for a lesser rig. Listen sometime to how much distortion a 6.5" woofer puts out in comparison to 15". I prefer not to introduce that level of distortion into low end performance. :)
As usual, YMMV
As usual, YMMV