Yes, implementation matters a great deal. It's impossible to "perfectly" isolate all other variables to do a "fair" comparison to these 2 tweeter types. I do have one experience that sticks out - I've heard all the Acora spekears at my local dealer (who sadly is now retiring). The most musical, enjoyable experience I've had is with the smaller SRC-1 tower. That's their ONLY model with a soft dome tweeter - all the others use beryllium!
I specifically listened to SRC-2 (extra woofer, and beryllium tweet) and SRC-1 on the same day. The SRC-2 had the advantage of higher-end VAC gear (much more $$$$), while the SRC-1 was on older (but still very, very high end) VAC. SRC-1 had the advantage of a smaller room, which frankly I probably prefer to the larger room in this shop where the SRC-2 were situated (so that's a big factor).
Anyways, I really enjoyed the SRC-1 with its non-exotic textile tweet. I'm a die-hard Tannoy fan, but this was one of those moments that had me thinking I could be happy with a non-Tannoy. I still "like" the sound of beryllium (also on some Focals, like Sopra 3), but certainly there's a certain "hardness" to it that I suspect would not fare well for me in the long-run. This character even pervades into the Focal Utopia and Stellia headphones. I've owned the Utopia headphones twice, and sold them. Certainly, the best headphones in my experience all use "soft" diaphragm materials. The issue of ear fatigue is much more severe with headphones.
And that brings me back to my Tannoys, which use very non-exotic (aluminum or aluminum & magnesium alloy) "hard" tweeters. However, the implementation is quite different than most - with either the tulip wave guide or pepperpot horn / compression driver. Careful gear matching is required so the tweeters don't "bite" my ears - more so with the pepperpots. But when properly accommodated, they don't have the hardness of beryllium. And the end result is well worth it, to me :)
In short, I'm skeptical of exotic "hard" tweeter materials, as far as their contribution to musicality and value to long-term enjoyment.