I agree with Phd,
My second best guess is the listener has not acclimated themselves to the "flaws" of the most recently attached speaker until some time passes. All speakers have a personality and none are without flaws.
I think the answer here might be that after components are on for a while, the circuits stabilize, they reach their optimum operating temperature & the sound will usually change for the better, could be for the worse. It may be you like the sound better before this happens!
My second best guess is the listener has not acclimated themselves to the "flaws" of the most recently attached speaker until some time passes. All speakers have a personality and none are without flaws.