Speakerphone with beamformer-based conference characterization and related methods
A speakerphone is disclosed. The speakerphone comprises an interface, a speaker, a plurality of microphones, a processor, and a memory. The speakerphone is configured to: obtain a first plurality of microphone input signals of a conference; determine a first plurality of beamforming parameters; obtain a first internal output signal for provision of a first internal audio output signal; output the first internal audio output signal; obtain a third microphone input signal associated with the first internal audio output signal; obtain a second internal output signal for provision of a second internal audio output signal; output the second internal audio output signal; obtain a fourth microphone input signal associated with the second internal audio output signal; determine a first impulse response; determine a second impulse response; and determine one or more conference parameters indicative of a conference configuration, the one or more conference parameters including a first conference parameter; and output the first conference parameter.
1 . A speakerphone, the speakerphone comprising an interface, a speaker, and a plurality of microphones, the speakerphone comprising a processor and a memory, wherein the speakerphone is configured to:
obtain, using the plurality of microphones, a first plurality of microphone input signals of a conference;
determine, using the processor and based on the first plurality of microphone input signals, a first plurality of beamforming parameters;
obtain, using the processor, a first internal output signal for provision of a first internal audio output signal in the conference;
output, using the speaker and based on the first internal output signal, the first internal audio output signal in the conference;
obtain, using the plurality of microphones, a third microphone input signal associated with the first internal audio output signal;
obtain, using the processor, a second internal output signal for provision of a second internal audio output signal in the conference;
output, using the speaker and based on the second internal output signal, the second internal audio output signal in the conference;
obtain, using the plurality of microphones, a fourth microphone input signal associated with the second internal audio output signal;
determine, using the processor and based on the first internal output signal and the third microphone input signal, a first impulse response associated with the conference;
determine, using the processor and based on the second internal output signal and the fourth microphone input signal, a second impulse response associated with the conference; and
determine, using the processor and based on the first plurality of beamforming parameters, the first impulse response, and the second impulse response, one or more conference parameters indicative of a conference configuration, the one or more conference parameters including a first conference parameter; and
output the first conference parameter, and
where the processor comprises a beamforming module configured to operate according to beamforming settings, and wherein the speakerphone is configured to control, based on the first conference parameter, the beamforming module.
2 . Speakerphone according to claim 1 , wherein the first plurality of microphone input signals are obtained at a first time and the second plurality of microphone input signals are obtained at a second time, and wherein the second time is after the first time.
3 . Speakerphone according to claim 1 wherein the speakerphone is configured to:
obtain, using the plurality of microphones, a second plurality of microphone input signals of the conference;
determine, using the processor and based on the second plurality of microphone input signals, a second plurality of beamforming parameters; and wherein to determine the one or more conference parameters is based on the second plurality of beamforming parameters.
4 . Speakerphone according to claim 3 , wherein the first plurality of microphone input signals are obtained at a first time and the second plurality of microphone input signals are obtained at a second time, and wherein the second time is after the first time.
5 . Speakerphone according to claim 1 , wherein the third microphone input signal is obtained at a third time and the fourth microphone input signal is obtained at a fourth time, and wherein the fourth time is after the third time.
6 . Speakerphone according to claim 1 , wherein to determine the one or more conference parameters comprises to determine a first difference between the first plurality of beamforming parameters and the second plurality of beamforming parameters.
7 . Speakerphone according to claim 6 , wherein the speakerphone is configured to, in accordance with a determination that the first difference satisfies a first criterion, set the first conference parameter to indicate a change in audio source position in the conference.
8 . Speakerphone according claim 1 , wherein to determine the one or more conference parameters comprises to determine a second difference between the first impulse response and the second impulse response, and wherein the speakerphone is configured to, in accordance with the second difference satisfying a second criterion, set the first conference parameter to indicate a change in acoustics in the conference.
9 . Speakerphone according to claim 6 , wherein the speakerphone is configured to, in accordance with a determination that the first difference satisfies the first criterion and in accordance with a determination that the second difference does not satisfy the second criterion, set the first conference parameter to indicate a turn taking in the conference.
10 . Speakerphone according to claim 9 , wherein the speakerphone is configured to, in accordance with a determination that the first difference satisfies the first criterion and in accordance with a determination that the second difference does not satisfy the second criterion, set the first conference parameter to indicate a turn taking in the conference and to indicate a speaker being stationary in the conference, and determine a third plurality of beamforming parameters based on the first conference parameter, the third plurality of beamforming parameters being associated with one or more participants of the conference.
11 . Speakerphone according to claim 2 , wherein the speakerphone is configured to store the third plurality of beamforming parameters and use the third plurality of beamforming parameters as beamforming settings for the beamforming module.
12 . Speakerphone according to claim 6 , wherein the speakerphone is configured to, in accordance with a determination that the first difference satisfies the first criterion and in accordance with a determination that the second difference satisfies the second criterion, set the first conference parameter to indicate a speaker moving in the conference.
13 . Speakerphone according to claim 1 , wherein the conference configuration comprises one or more of: a number of participants in the conference, a position of a speaker in the conference, a size of an environment of the conference, turn-taking information, and a level of absorption in the conference.
14 . A system comprising a speakerphone according to claim 1 and a server device.
15 . A method of operating a speakerphone, wherein the method comprises:
obtaining, using the speakerphone, a first plurality of microphone input signals of a conference;
determining, using the speakerphone and based on the first plurality of microphone input signals, a first plurality of beamforming parameters;
obtaining, using the speakerphone, a first internal output signal for provision of a first internal audio output signal in the conference;
outputting, using the speakerphone and based on the first internal output signal, the first internal audio output signal in the conference;
obtaining using the speakerphone, a third microphone input signal associated with the first internal audio output signal;
obtaining, using the speakerphone, a second internal output signal for provision of a second internal audio output signal in the conference;
outputting, using the speakerphone and based on the second internal output signal, the second internal audio output signal in the conference;
obtaining, using the speakerphone, a fourth microphone input signal associated with the second internal audio output signal;
determining, using the speakerphone and based on the first internal output signal and the third microphone input signal, a first impulse response associated with the conference;
determining, using the speakerphone and based on the second internal output signal and the fourth microphone input signal, a second impulse response associated with the conference;
determining, using the speakerphone and based on the first plurality of beamforming parameters, the first impulse response, and the second impulse response, one or more conference parameters indicative of a conference configuration, the one or more conference parameters including a first conference parameter; and
outputting the first conference parameter.