Can anyone reasonably argue that today's young songwriters are putting out music with lyrics comparable to those songs? I doubt it.
How much effort have you put into exploring contemporary songwriters?
I haven't read through the entire thread and I'm not singling you out here, but I am going to point out an elephant in the room. None of us are wholly immune to favoring what we like -- what is familiar -- and regarding it as "best". I've noted this tendency in myself over and over.
An example of a superb contemporary lyricist:
https://www.youtube.com/watch?v=Hbyc4vSimlo&list=OLAK5uy_nupQhyPmczHDy01DZww9h857BXmNekeNU&index=2