Congratulations! You have discovered an aspect of audiophilia that is quite appealing to a subset of enthusiasts! These are the listeners who as a pursuit, a goal, seek variety.
Some of this is in my character, and I see it expressed in my life also in terms of motorcycles. I would rather have two fine motorcycles of quite different genre (cruiser/sport) than one considered higher pedigree. The excitement of the distinct difference in experience is better imo than being held to only one experience. I have no doubt that in the moment, riding a higher level bike would provide some unique experiences, however it cannot provide the variety of experiences. That is the crux of the dilemma; if you put your money to work in a restricted fashion, then you will not get the variety of experiences, or at least not when you wish.
I spent a long time searching for "The One", the one speaker, the one system that would ultimately satisfy. Because I always heard deficiencies in the sound regardless of what equipment was used, I finally realized the performance spectrum is SO wide, and the inability for any rig to capture a nearly perfect sound internet, that I started to expand my components and speakers. Over the years, the focus has turned solidly to speakers, because their physical characteristics are so varied that one simply cannot get similar sound from a different genre of speaker. I also learned that this does not change as one moves up in the quality of the electronics.
This has brought FAR more contentment, enjoyment, exposure to the experiences of the High End than any pursuit of The One. Variety is not a problem, but a great passion and pursuit. It is a legitimate means of enjoying the music, of course not for all, but every bit as valid as any other expression of involvement in the hobby, i.e. being a Mediaphile and focusing on collecting and curating media.
What level of equipment does one need to attain in order to not be plagued by perceived imperfections in the sound quality? That is for you to figure out; it’s personal. But, I attest that when one reaches a high enough level of sound quality with the capability of swapping around systems, it is a pleasure that nothing else in this hobby for decades provided.
Concluding, then, your post as stated in the title suggests that variety is a sign of some issue, problem. Not at all! It's only a problem if you are unaware of the vast spectrum of performance, cannot accept deficiencies in systems, and do not want to spend any money! If you address the realities of the process of setting up rigs and accept that it is a great alternative to anchoring to one expression of sound, pursuit of variety is fantastically fulfilling!
