Too much sound in your mind, not enuf in your ears I think. There is no right or wrong re toe in, it's what actually works for you. I would agree the aesthetically it might be a bit hard to think it could be right (for you) because few seem to do this. However, it is often done at audio shows to accommodate room/set up problems.
You mentioned the tweeter off axis sounding better because it dials down the sound, but consider that the same 'off axis' can be achieved by pointing the speakers straight ahead. Much of what is achieved by toe in (or actually toe out for the really venturesome) is brought about by the change in sound from room reflections. Ditto diffusion/deadening wall treatment.
One thing to think about, and much depends of speaker design, i.e. strength of the off axis signal, is what happens to the off axis signal when you change the speakers toe in. Pointed straight ahead you get a strong side wall reflection (if you have a side wall!) but toed in you change that reflection (but you knew that). Probably what you did not consider is what happens to the off axis signal on the other side. What you have by doing 'severe' toe in is to point that off axis signal off the wall between your speakers. Enter again the importance of the use (or not) of reflective/deadening/dispersive material between the speakers, not just behind or to the side of, the speakers. For the really anal amongst us, don't fail to consider the 2d reflections points, they can be important as well. :-)
Too complex for the poor mind I think. It may be just simpler just to move your speakers about and listen to the results as you go. DON'T be in a hurry, beyond initial first impressions, the effects of moving speakers which are already established in a good place can be subtle and in my case affect the sound stage, especially image's third dimension, depth of image. No kidding, it probably took me over a year to set up my Quad 63'. And they don't have a strong off axis signal. My present speakers which are just forward firing boxes, not near so much!
Enuf for now, I'm even boring myself. :-)