Getting a small driver to do bass is hard. Its a matter of excursion.
Getting it to do the highs is an entirely different problem! You get cancellation in the cone, which is why many single-driver speakers have a device called a phase plug the helps prevent cancellation.
Then you often get comb-filtering effects in the cabinet, which is why the midrange can get harsh (and also why many people prefer open back setups, or else really expensive cabinetry that solves the comb filtering issue...).
So you are right. Not an easy simple answer.
Getting it to do the highs is an entirely different problem! You get cancellation in the cone, which is why many single-driver speakers have a device called a phase plug the helps prevent cancellation.
Then you often get comb-filtering effects in the cabinet, which is why the midrange can get harsh (and also why many people prefer open back setups, or else really expensive cabinetry that solves the comb filtering issue...).
So you are right. Not an easy simple answer.