I invite one person over and I take a nearby seat. While I get a bit anxious with so many people in my listening room, I am able handle it.
Alternatively, find a room on the other side of the house, away from your listening room so the three of you can talk and not be heard and ruin it for the person listening. Then trade.
I could go on.