The formal answer is that toe in affects tweeter rolloff, the width of the sweet spot, the treble to midrange balance and early reflections. There's also the issue of some excellent tweeters may have resonances which completely vanish a little off axis.
Many speaker brands are designed to optimally perform with little or no toe-in. I include:
- Magico
- Focal
- Revel
Magico and Revel in particular have great imaging across a wide listening area when placed with little toe-in and plenty of space to the sides and rear.
A little history may be helpful. In the last 30 years or so tweeter manufacturing has come a long long way. Cheap (< $50) tweeters often flat past 20 kHz, wide dispersion and low energy storage. In the old days this was the realm of exotics, and if you wanted to hear everything you needed to point the speaker right at your head.
A related issue IMHO is the tweeter height. Some speakers, like B&W, really should be listened to on mid-range height, not tweeter height. So in general the best listening position for many speakers in the 21st century is with little toe in and perhaps significantly below the tweeter's laser like axis.