Tube amps with output impedances greater than 1 ohm will not have a flat response into a speaker's varying impedance. They will act as tone controls! So, choose your tube amp/speakers with this consideration in mind!While this is off topic, the actual situation is more complex than described above. This is because all amps make distortion, and the ear interprets distortion as tonality *unless the amp is clipping*. Apparently the brain has tipping points, where its processing of the sound changes from one portion of the brain to another- in the case of distortion, the brain can actually favor tonality caused by distortion over actual frequency response errors (or lack thereof). For this reason, an amplifier with a higher output impedance can often come off as more neutral than an amplifier with a lower output impedance, even though the latter is more 'flat'.
In the case of the OP, I think trying different taps is a good idea, and it may also be a good idea to try a different speaker cable. Tube amps have generally higher output impedances and so appear more sensitive to cables. For this reason its always a good idea to keep the speaker cables as short as possible.