The consensus is that power supply electrolytic caps should at least be considered for replacement when they start to get up in age. But, that really is a generalization and it really depends on the source/quality of the parts. I know a current builder that looks for certain older parts, including electrolytic caps, because he likes what they do in his designs. I am thinking of getting a linestage from this builder, based on an in-home audition. None of the parts, including the electrolytic caps are any younger than 50 years old and some parts are much older.
Some of these parts, made by such companies as Western Electric, command quite high prices on the market today.