OP,
Go for it! I am 70 and retired. I spent 50 years learning, reaching, and investing. Now, I am able to listen to my system for three hours a day. It is my most rewarding asset. Well worth the continual investment and work I have put into it. Actually in order of resale value my house is number one, my audio system is two, and my new 4Runner and Lexus is third in value. When I die, it gets liquidated to support my partner or to charity.