Systems and methods for integrated conferencing platform
A software-based conferencing platform is provided. The platform comprises a plurality of audio sources providing input audio signals, the audio sources including a virtual audio device driver configured to receive far-end input audio signals from a conferencing software module, and a network audio library configured to receive near-end input audio signals from one or more near-end audio devices. The platform further comprises a digital signal processing component configured to receive the input audio signals from the audio sources and generate audio output signals based the received signals, the digital signal processing component comprising an acoustic echo cancellation module configured to apply acoustic echo cancellation techniques to one or more of the near-end input audio signals.
1 . A software-based conferencing platform at least partially operating on a server of a cloud computing network, the server communicatively coupled to a local computing device, the software-based conferencing platform comprising:
a plurality of audio sources configured to provide input audio signals, the input audio signals comprising far-end input audio signals from a conferencing software module included in the local computing device, and near-end input audio signals from one or more near-end audio devices communicatively coupled to the local computing device; and
a system configuration component configured to:
obtain device information for each near-end audio device of the one or more near-end audio devices;
for each near-end audio device of the one or more near-end audio devices, retrieve, from a memory, one or more audio processing parameters associated with corresponding device information for the near-end audio device; and
provide the one or more audio processing parameters to a digital signal processing component to automatically configure corresponding settings of the digital signal processing component based thereon.
2 . The software-based conferencing platform of claim 1 , further comprising:
a controller module located at least partially on the server of the cloud computing network and configured to interface with the system configuration component, the plurality of audio sources, and a digital signal processing component, wherein the controller module is configured to control one or more near-end audio devices located external to the local computing device.
3 . The software-based conferencing platform of claim 1 , further comprising a mute logic module configured to:
receive a mute request from a given audio source, the mute request comprising a mute command or an unmute command; and
provide the mute request to the digital signal processing component to synchronize a mute status of the given audio source across all other audio sources in the software-based conferencing platform based on the mute request.
4 . The software-based conferencing platform of claim 1 , further comprising the digital signal processing component, wherein the digital signal processing component is configured to:
generate processed near-end audio signals by applying the one or more audio processing parameters associated with each near-end audio device to the input audio signals received from that near-end audio device, thereby automatically configuring the corresponding settings of the digital signal processing component; and
generate audio output signals based on the far-end input audio signals and the processed near-end input audio signals.
5 . The software-based conferencing platform of claim 4 , wherein the digital signal processing component comprises an automixing module configured to mix or more of the processed near-end input audio signals to generate an automix output signal, and the system configuration component is further configured to optimize one or more settings of the automixing module.
6 . The software-based conferencing platform of claim 4 , wherein the digital signal processing component comprises a matrix mixing module configured to generate the audio output signals.
7 . The software-based conferencing platform of claim 4 , wherein the digital signal processing component comprises a clock synchronization module configured to synchronize the input audio signals to a single clock.
8 . The software-based conferencing platform of claim 1 , wherein the plurality of audio sources comprises a virtual audio source configured to receive the far-end input audio signals from the conferencing software module and appear as an echo-cancelling speakerphone to the conferencing software module.
9 . The software-based conferencing platform of claim 1 , wherein the system configuration component is configured to obtain the device information from each of the one or more near-end audio devices during a device discovery process, the one or more near-end audio devices configured to automatically transmit the device information to the local computing device during the device discovery process.
10 . The software-based conferencing platform of claim 1 , wherein at least a portion of the software-based conferencing platform operates on the local computing device.
11 . The software-based conferencing platform of claim 1 , wherein the system configuration component is further configured to transmit, to each near-end audio device of the one or more near-end audio devices, audio pick-up pattern information for an audio lobe assigned to the near-end audio device for receiving the near-end input audio signals captured by that near-end audio device, the audio lobe corresponding to one of a plurality of channels at the digital signal processing component.
12 . A computer-implemented method of audio processing for a conferencing environment using a server of a cloud computing network and a local computing device communicatively coupled to the server, the computer-implemented method comprising:
receiving input audio signals from a plurality of audio sources, the input audio signals comprising far-end input audio signals from a conferencing software module included in the local computing device, and near-end input audio signals from one or more near-end audio devices communicatively coupled to the local computing device;
obtaining, using a system configuration component, device information for each near-end audio device of the one or more near-end audio devices;
for each near-end audio device of the one or more near-end audio devices, retrieving, from a memory, one or more audio processing parameters associated with corresponding device information of the near-end audio device; and
providing the one or more audio processing parameters to a digital signal processing component to automatically configure corresponding settings of the digital signal processing component based thereon.
13 . The computer-implemented method of claim 12 , further comprising:
generating processed near-end input audio signals by applying, using the digital signal processing component, the one or more audio processing parameters associated with each near-end audio device to the input audio signals received from that near-end audio device, thereby automatically configuring the corresponding settings of the digital signal processing component; and
generating audio output signals based on the far-end input audio signals and the processed near-end input audio signals.
14 . The computer-implemented method of claim 13 , further comprising:
mixing, using an automixing module included in the digital signal processing component, two or more of the processed near-end input audio signals to generate an automix output signal, and
optimizing, using the system configuration component, one or more settings of the automixing module.
15 . The computer-implemented method of claim 13 , further comprising generating the audio output signals using a matrix mixing module of the digital signal processing component.
16 . The computer-implemented method of claim 13 , further comprising:
transmitting, to each near-end audio device of the one or more near-end audio devices, using the system configuration component, audio pick-up pattern information for an audio lobe assigned to the near-end audio device for receiving the near-end input audio signals captured by that near-end audio device, the audio lobe corresponding to one of a plurality of channels at the digital signal processing component.
17 . The computer-implemented method of claim 13 , further comprising:
synchronizing the input audio signals to a single clock using a clock synchronization module included in the digital signal processing component.
18 . The computer-implemented method of claim 12 , wherein the plurality of audio sources comprises a virtual audio source for receiving the far-end input audio signals from the conferencing software module, the virtual audio source appearing as an echo-cancelling speakerphone to the conferencing software module.
19 . The computer-implemented method of claim 12 , further comprising:
obtaining, using the system configuration component, the device information from each of the one or more near-end audio devices during a device discovery process, the one or more near-end audio devices automatically transmitting the device information to the local computing device during the device discovery process.
20 . The computer-implemented method of claim 12 , further comprising:
receiving a mute request from a given audio source, the mute request comprising a mute command or an unmute command; and
providing the mute request to the digital signal processing component to synchronize a mute status of the given audio source across all other audio sources in a software-based conferencing platform, at least partially operating on the server, based on the mute request.