Just a note from my son.

My son does audio work. It's his paying job. He tells me that to solve this he uses a mixer. But that's not his preferred solution. His preferred solution is to have an audio recorder then mix it all back up in post production.

Hope this helps,
Bob