In my research I found the overwhelming evidence and opinion is that Bach, NOT Handel was the main Baroque influence.
It was said that when a new edition of the Bach Gesselschaft (just being compiled at the time) came to him, he would eagerly pour over it. But when a new Handel tome came he said he would “get to it later.”
In concerts, Brahms as choral conductor profusely included Bach in programs.
Handel was scarcely to be found.
The so called “fire and fury,” (mentioned by Baroque writers) of the Vivaldi-Bach concerto style is to be found often in Brahms style. Not so, the more sedate Corelli-Handel concerto grosso style.
As mentioned, Brahms would improvise on the piano and organ for hours in the manner of Bach organ writing.
Indeed his final opus contained chorale preludes in homage to Bach.
I can see where a cursory opinion might be formed regarding Handel.
After all, he did write “Variations and Fugue on a Theme by Handel.”
But the consensus among scholars is that Bach is the man.