It's the speaker ...
uh, the amp ...
uh, the amp and the speaker working together ...
us, and the signal strength coming from the source component ...
and of course the mastering on the vinyl/CD ...
oh yeah, and throw the preamp in there because, you know, it's in the signal chain and has gain too, unless you're running a passive and this discussion is moot to you.
:-)