...I had an XA-25 for a trial driving a pair of Spatial X5’s (97db efficiency). That combo produced imaging depth like I have never heard before or since.
The Spatial is an excellent speaker and easy to drive. But since you have to keep the speakers closer to the wall behind them, its probably not a good idea to use a speaker with rear-firing information. If less than about 5 feet to the wall behind the speaker, the reflected information will be interpreted by the ear as harshness rather than imaging detail.
But I think if you liked the Pass, going to a more efficient, easy to drive speaker is the way to go. All amps make more distortion driving difficult loads! This causes them to sound less musical.
With most amps out there, you'll find that tube amps do a better job of imaging and depth than most transistor amps. So the tip about keeping the speaker easy to drive will play very well into the idea of a tube amp if you go in that direction; it will also work nicely with the Pass if you still have it (that amp is fairly low power so you'll need a speaker that has efficiency in the high 90s, like the ZU Audio stuff).