Are you going to share the specifics on your speakers? I’m a huge fan of the EL84 tube but depending on your speakers, they could be wrong. It also depends on the amp topology. A single ended el84 amp begins to distort at 5ish watts with max power 9-10 watts per channel. Push pull begins to distort around 6-9 watts and tops out around 12-15 wpc. Some of the old Scott’s that use the 7189 can be pushed a little further to achieve high teens realistically. I believe the EAR, quicksilver, Manley and some others use 8 rather than four el84’s so those numbers can double up.
Once again though, if you would share your speakers with us we might be able to provide better advice. 4ohm? All bets are off. Crossovers with 50 year old caps? Ditto.