I think a lot of audiophiles reach this point in their journey, at which point some of them bail, some make a major course direction, some scrap everything and start over, and some continue listening because current audiophile orthodoxy tells them that what they're hearing is what they ought to like (or be pursuing).
It's all in component selection and component synergy. Perhaps a start might be made by replacing some part of your system with something different that is widely described as "forgiving" (or musical, or very natural) and see if it begins to lead you in the right direction.
