Why Energize the Whole Room/Virtual Reality Audio?

Nearly all high quality loudspeakers are designed to fill, or at least attempt to fill, an entire room with sound. Why haven't more manufacturers and listeners taken an alternative path towards a more localized and individually oriented sound reproduction paradigm? I'm inspired by the concept of virtual reality video glass where the moving picture image is placed so close to the eye that the viewer is totally immersed in the image. Why not place the speakers within inches of the listener's head? Since you're not trying to fill a room with sound the speakers could be physically smaller (and cheaper) and the drivers should have less travel (and lower distortion) than traditional loudspeakers setups. Soundstaging and imaging should be greatly enhanced and the negative effects of the listening room should be greatly minimized. Except for the social aspect of sharing music with friends or it's impracticality for listening to music in the background, maximum extreme nearfield listening (MENL, pronouced MEN-L) should have enormous appeal for the serious listener. Or, am I missing something? I've never actually tried those virtual reality glasses, so I really don't know if they work let alone this idea inspired by the VR glasses.

On a practical note, this concept would probably require a single cone or planar type speaker in order to maintain coherence and proper sound integration which is probably not a bad thing. If anybody reading this has a pair of those mini Gallo balls, try placing them free field six inches in front of your head and let us know how they sound.

The obvious question is, why not just use headphones? Unless the music was recorded for headphone playback you'll get that sound in the middle of your head effect. I'm looking for a properly placed soundfield.