As someone that, in my youth, frequented live rock venues as often as possible at the time, worked as an aircraft assembler (shooting and bucking rivets and Huck bolts, very loud when the stem breaks off), and for the last 35-40 years was a heavy equipment operator, and I am also cursed with 24/7 tinnitus.
I spent a lot of time, and quite a few dollars, getting my system to where it is now, (which is the best it's ever been in 40 years). Contrary to my (and your) fears, my hearing did not keep me from hearing even subtle improvements in the system. Music listening is the most satisfying and enjoyable it's ever been for me, my hearing not withstanding. Don't worry too much, if your hearing isn't too much different than mine, you most likely will be fine.
I spent a lot of time, and quite a few dollars, getting my system to where it is now, (which is the best it's ever been in 40 years). Contrary to my (and your) fears, my hearing did not keep me from hearing even subtle improvements in the system. Music listening is the most satisfying and enjoyable it's ever been for me, my hearing not withstanding. Don't worry too much, if your hearing isn't too much different than mine, you most likely will be fine.