Or is is there something about letting one amp not work as hard due to only running high frequencies while the other amp gets to just work on the low end."
It all boils down to how many circuits are executed between the source signal to the target speaker. Each circuit introduces its own noise and distortion however minor. So when the unamplified signal goes into a dedicated circuit of HF amp to HF speaker cones and the same unamplified signal goes to another dedicated circuit of LF amp and LF cone, each cone can pull as much power as it needs for the track without affecting the other circuit.
When not bi-amped, the speaker wires carries the entire load of amplified current to the speaker and the speaker filters are the only ones separating the LF current from the HF current.
Bottomline: The closer to the source you separate the current, the nicer it will sound. Nicer being subjective as some listeners do like a bit muddier tone for certain music.