turnbowm9,
At the risk of just restating the obvious, in case you stopped your toe in process in route to an optimum set up---
One of the benefits of toe in is to ameliorate the effects of side wall reflections, but as you have noted you pick up some brightness as you toe in the speaker and get closer to listen on the axis of the speaker. If you continue the toe in until the speaker's axis is well in front of your listening position you will not only have reduced the sidewall reflections substantially but you will now have a more tonally balanced sound. As Duke said (in effect) it looks a bit cross eyed but it really works well. In medium sized and smaller rooms it can be a life saver (so to speak). And now that you don't have to push your speakers close to the wall to overwhelm the highs with bass tones, you enhance you imaging, especially depth of image.
IME, the maximum toe in past your listening position would be similar to the angle if your speaker were pointed straight ahead, ie. you speakers manufacturer recommends pointing you speakers straight ahead, using a equilateral triangulated set up your toe in could be as much as 22.5 degrees.
FWIW, works well for me in a 19.5x13.5x9 ft room.