Aarif, removing distortion never causes an amplifier to have fake neutrality.
OTLs have an economy of scale- the bigger you make them, the more efficient they can run. A big OTL that can make 200 watts will very likely be comfortable on 4 ohms, some smaller ones that make 150 watts might be able to do that also. A 30-watt OTL will not like 4 ohms much at all.
IOW the smaller you make the OTL, the higher you will want the load impedance to be. Many OTL headphone amps are designed for 32 ohms or more, plus they do not have to make more than 0.2 watts. Headphone amplifiers also are a special case because most headphones are designed to operate with amplifiers that have a much higher output impedance than their own impedance.
Without more information about your speakers, it would be hard to make a certain case for either amplifier technology, and we have to include your listening preferences somehow too. Although I have heard very good things about the Graaf, I've not actually heard it, so the following is my opinion only. I think it would have a chance at being a more neutral, musical presentation if the speaker impedance is linear and 7 or 8 ohms at least. I don't agree with some of the tube choices in that amplifier, as I feel that they tend to make the amp sound brighter, so I do have reservations at the same time.
In the end, like so many other things in audio, you will have to audition to know for sure. Remember- its all supposed to be fun :)
