YES "Audiokinesis", dipoles are exception ( rear wall seams to play far more important role in setting up those kind of speakers then reflection points on side walls). Speakers with very small radiation pattern are indeed less affected by side walls sound reflecting surface. Like you said , with careful placement and toe-in side reflections can be greatly reduced.
Good example would be a pair of Martin Logan speakers. They are dipoles and have radiation of about 30 degree horizontal and almost non vertical. Initially, someone may think that Martin Logans have to be easy to setup and are room friendly ( side reflections play very little factor with ML ). That someone could not be farther from the truth. In fact those speakers are difficult and tricky. However when setup is optimize they can be very rewarding ( got'em for 6 years ).