Why do you have to remove the passive components from the speakers, don't you just have to bypass them and can still leave them in the speaker cabinet?
You could leave them in the box, but they should be disconnected from the drivers. You could bypass them, but the possibility of screwing up is not zero. In the case of the Legacy SE, the speakers should likely be tri-amped as there is an XO between the mid and tweet. If done properly, the speaker was voiced to compensate for driver/XO interaction.
Something like the Dayton is pretty basic and the A/D is probably quite audible.
XO & D/A should be implemented in the digital domain. However, doing that properly is not trivial for what looks to be a fairly complex XO in the SE: