Do I trust my ears? I do and I don't. The problem to me, is what others have alluded to. I can always hear a difference in any change to my system. but is it better, or just different?
I believe our brains are hard wired to seek change, differnce, in what we see, hear etc. This means an inate prejudice to what is new. To me it nearly always sounds better. The only answer, as URu975 says, is does the change meet the test of time. Does a new component make you want to listen more over time? Are you listening to different music? In other words, has the change favoured a particular genre of music? For example, I have just added a SET amp to a hybrid integrated, both are wonderful, but I find myself picking out small scale Jazz or singer songwriter albuns, rather than classical symphonies.