Wake up!! Did you come down with the last shower?
It doesn’t sound ****, like your making out.
And of course, leave out any buffer regardless of how good if one can with high output source, and you’ll reap those benefits of extra transparency/dynamics and slam, by going direct into the Class-D module with no buffer at all in the way.
And that Hypex buffer is a perfect match with the Purifi module, that’s why it’s called and marketed as a buffer.
It something else the OP is hearing, and you know what that leaves, the Purifi module itself!