10-09-15: DjfstI found your speaker measurements here:
High end audio is definitely tricky. For example, I'm running a Primaluna Dialogue HP Integrated Amp with EL34 tubes to Sonus Faber Olympica III Speakers which are 91db efficient and are 4ohms rated according to specs. The Primaluna has 4ohm taps and 8ohm taps, and the 4ohm speakers sound far better on the 8ohm taps.
http://www.soundstagenetwork.com/index.php?option=com_content&view=article&id=1285:nrc-measurements-sonus-faber-olympica-iii-loudspeakers&catid=77:loudspeaker-measurements&Itemid=153
if you scroll down & look at the 2 plots "impedance magnitude variation" & "phase angle" you can see that this speaker has capacitive phase angles in the bass region to, oh, ~150Hz. The impedance is complex i.e. has a x+jy sort of form. So, the real part of the speaker impedance into the power amp is delivering current is not 4 Ohms as printed on the back of the speaker but less than 4 Ohms due to the capacitive (reactive) phase angle. So, any power amp would be asked to deliver more current than originally thought (since you are thinking it's a 4 Ohm speaker) & this can tax the power amp.
When you connect your SF to the 8 Ohms tap, the power amp is being asked to deliver more current into the lower (4 Ohms) speaker impedance compared to when you have it connected to the 4 Ohms tap. The higher current delivered yields a better bass response.
The plots show the speaker is mostly inductive in the 150Hz-2.5KHz. So, when high voltages are present in the mid-bass-to-mid-range little current is asked from the power amp due to this inductive impedance nature of this speaker in this region (the math omitted deliberately). And, in the high-freq even tho the speaker become capacitive there is not much energy in those frequencies so the power amp is not taxed much.
So, it seems to make sense that this SF speaker would sound better on the 8 Ohms tap.