Granted Patent B2

US 9,837,100 · App. 14/704,450 · Granted Dec 5, 2017

Abstract

Claims (91)

1. A method of conducting an online meeting, the method comprising:

receiving microphone input from a microphone of a participant of the online meeting;

obtaining online meeting input from an online meeting device remote from the online meeting participant; and

providing, to a speaker of the participant of the online meeting, a speaker output containing (i) at least a portion of the microphone input and (ii) the online meeting input;

wherein the microphone input contains high-volume sound and low-volume sound;

wherein the method further comprises:

separating the microphone input into a participant voice component and an ambient sound component, the participant voice component containing the high-volume sound, the ambient sound component containing the low-volume sound;

rendering the low-volume sound contained in the ambient sound component to produce a rendered ambient sound component;

prior to providing the speaker output to the participant of the online meeting, combining the rendered ambient sound component and the online meeting input to produce the speaker output;

providing, over a first channel, the participant voice component to the other participants of the online meeting;

providing, over a second channel, the ambient sound component to a mixing component in which the ambient sound component and the online meeting input are combined; and

performing, over the second channel, a filtering operation on the participant voice component, the filtering operation suppressing the high-volume sound contained in the participant voice component;

wherein rendering the sound contained in the ambient sound component includes:

resolving the ambient sound component into a set of ambient sound subcomponents, each of the set of ambient sound subcomponents containing sounds in different volume ranges; and

for each of the set of ambient sound subcomponents, generating a weight corresponding to that ambient sound subcomponent based on a volume of the sound contained in that ambient sound subcomponent;

wherein combining the ambient sound component and the online meeting input includes performing a weighted addition of the online meeting input and each of the set of ambient sound subcomponents based on the generated weights;

wherein the speaker output is provided to the speaker over a left audio channel and a right audio channel; and

wherein, for each of the set of ambient sound subcomponents, generating the weight corresponding to that ambient sound subcomponent includes producing a left weight and a right weight corresponding to that ambient sound subcomponent, a volume of the sound contained in that ambient sound subcomponent being provided to the speaker over the left audio channel according to left weight corresponding to that ambient sound subcomponent, a volume of the sound contained in that ambient sound subcomponent being provided to the speaker over the right audio channel according to the right weight corresponding to that ambient sound subcomponent.

2. A method as in claim 1 , further comprising:

receiving a mute indicator indicating that the high-volume sound contained in the participant voice component is not to be heard by the other participants of the online meeting; and

performing, over the first channel, a second filtering operation on the participant voice component to suppress the sound contained in the participant voice component.

3. A method as in claim 1 , further comprising:

receiving an ambient mute indicator indicating that the low-volume sound is not to be heard by the participant; and

in response to receiving the ambient mute indicator, providing, to the speaker of the participant of the online meeting, a speaker output containing (i) the online meeting input and (ii) none of the microphone input.

4. A computer program product including a non-transitory, computer-readable storage medium which stores executable code, which when executed by a computer, causes the computer to perform a method of conducting an online meeting, the method comprising:

receiving microphone input from a microphone of a participant of the online meeting;

obtaining online meeting input from an online meeting device remote from the online meeting participant; and

providing, to a speaker of the participant of the online meeting, a speaker output containing (i) at least a portion of the microphone input and (ii) the online meeting input;

wherein the microphone input contains sound generated by the participant of the online meeting and sound generated in the vicinity of the participant of the online meeting;

wherein the method further comprises:

separating the microphone input into a participant voice component and an ambient sound component, the participant voice component containing the high-volume sound, the ambient sound component containing the low-volume sound;

rendering the low-volume sound contained in the ambient sound component to produce a rendered ambient sound component;

prior to providing the speaker output to the participant of the online meeting, combining the rendered ambient sound component and the online meeting input to produce the speaker output;

providing, over a first channel, the participant voice component to the other participants of the online meeting;

providing, over a second channel, the ambient sound component to a mixing component in which the ambient sound component and the online meeting input are combined; and

performing, over the second channel, a filtering operation on the participant voice component, the filtering operation suppressing the high-volume sound contained in the participant voice component;

wherein the speaker output is provided to the speaker over a left audio channel and a right audio channel;

wherein rendering the sound contained in the ambient sound component includes:

resolving the ambient sound component into a set of ambient sound subcomponents, each of the set of ambient sound subcomponents containing sounds in different volume ranges; and

for each of the set of ambient sound subcomponents, generating a weight corresponding to that ambient sound subcomponent based on a volume of the sound contained in that ambient sound subcomponent; and

wherein, for each of the set of ambient sound subcomponents, generating the weight corresponding to that ambient sound subcomponent includes producing a left weight and a right weight corresponding to that ambient sound subcomponent, a volume of the sound contained in that ambient sound subcomponent being provided to the speaker over the left audio channel according to left weight corresponding to that ambient sound subcomponent, a volume of the sound contained in that ambient sound subcomponent being provided to the speaker over the right audio channel according to the right weight corresponding to that ambient sound subcomponent.

5. A computer program product as in claim 4 , wherein the method further comprises:

receiving a mute indicator indicating that the high-volume sound contained in the participant voice component is not to be heard by the other participants of the online meeting; and

performing, over the first channel, a second filtering operation on the participant voice component to suppress the sound contained in the participant voice component.

6. A computer program product as in claim 5 , wherein rendering the sound contained in the ambient sound component further includes:

wherein combining the ambient sound component and the online meeting input includes performing a weighted addition of the online meeting input and each of the set of ambient sound subcomponents based on the generated weights.

7. A computer program product as in claim 4 , wherein the method further comprises:

receiving an ambient mute indicator indicating that the low-volume sound is not to be heard by the participant; and

in response to receiving the ambient mute indicator, providing, to the speaker of the participant of the online meeting, a speaker output containing (i) the online meeting input and (ii) none of the microphone input.

8. An electronic apparatus constructed and arranged to conduct an online meeting, the apparatus comprising:

a network interface;

memory; and

controlling circuitry coupled to the memory, the controlling circuitry being constructed and arranged to:

receive microphone input from a microphone of a participant of the online meeting;

obtain online meeting input from an online meeting device remote from the online meeting participant; and

provide, to a speaker of the participant of the online meeting, a speaker output containing (i) at least a portion of the microphone input and (ii) the online meeting input;

wherein the microphone input contains sound generated by the participant of the online meeting and sound generated in the vicinity of the participant of the online meeting;

wherein the controlling circuitry is further constructed and arranged to:

separate the microphone input into a participant voice component and an ambient sound component, the participant voice component containing the high-volume sound, the ambient sound component containing the low-volume sound;

render the sound contained in the ambient sound component to produce a rendered ambient sound component;

prior to providing the speaker output to the participant of the online meeting, combining the rendered ambient sound component and the online meeting input to produce the speaker output;

provide, over a first channel, the participant voice component to the other participants of the online meeting;

provide, over a second channel, the ambient sound component to a mixing component in which the ambient sound component and the online meeting input are combined; and

perform, over the second channel, a filtering operation on the participant voice component, the filtering operation suppressing the high-volume sound contained in the participant voice component;

wherein the controlling circuitry, when rendering the sound contained in the ambient sound component is constructed and arranged to:

resolve the ambient sound component into a set of ambient sound subcomponents, each of the set of ambient sound subcomponents containing sounds in different volume ranges; and

for each of the set of ambient sound subcomponents, generate a weight corresponding to that ambient sound subcomponent based on a volume of the sound contained in that ambient sound subcomponent;

wherein the controlling circuitry, when combining the ambient sound component and the online meeting input, is further and arranged to:

generate a weight corresponding to the online meeting input based on a volume of a sound contained in the online meeting input relative to the sound contained in each of the set of ambient sound subcomponents; and

perform a weighted addition of the online meeting input and each of the set of ambient sound subcomponents based on the generated weights;

wherein the speaker output is provided to the speaker over a left audio channel and a right audio channel; and

wherein the controlling circuitry, when generating the weight corresponding to that ambient sound subcomponent for each of the set of ambient sound subcomponents, is constructed and arranged to produce a left weight and a right weight corresponding to that ambient sound subcomponent, a volume of the sound contained in that ambient sound subcomponent being provided to the speaker over the left audio channel according to left weight corresponding to that ambient sound subcomponent, a volume of the sound contained in that ambient sound subcomponent being provided to the speaker over the right audio channel according to the right weight corresponding to that ambient sound subcomponent.

9. An apparatus as in claim 8 , wherein the controlling circuitry is further constructed and arranged to:

receive a mute indicator indicating that the high-volume sound contained in the participant voice component is not to be heard by the other participants of the online meeting; and

perform, over the first channel, a second filtering operation on the participant voice component to suppress the sound contained in the participant voice component.

10. A method of providing audio output to a user, the method comprising:

receiving, by processing circuitry, a microphone signal from a microphone of the user, the microphone signal containing voice input from the user and ambient noise in a vicinity of the user;

obtaining, by the processing circuitry, an audio signal containing audio from an external source; and

in response to the microphone signal and the audio signal, outputting, by the processing circuitry, a speaker signal to a speaker of the user, the speaker signal containing the ambient noise and the audio from the external source;

wherein the voice input is omitted from the speaker signal even though the ambient noise in the vicinity of the user is present within the speaker signal; and

wherein outputting the speaker signal to the speaker includes:

performing a filtering operation which takes the microphone signal as an input and produces the ambient noise as an output;

performing a mixing operation which receives the output of the filtering operation and the external audio signal and produces a combination of the ambient noise and the external audio signal as a resultant signal; and

providing, as the speaker signal, the resultant signal of the mixing operation.

11. A method as in claim 10 wherein the method further includes:

performing an additional filtering operation which takes the microphone signal as an input and produces the voice input as a resultant signal; and

outputting, by the processing circuitry, the resultant signal of the additional filtering operation to external receiving equipment remote from the user.

12. A method as in claim 11 , wherein producing the combination of the ambient noise and the external audio signal as the resultant signal includes:

decomposing the result of the filtering operation into a set of ambient noise components, each ambient noise component of the set of ambient noise components containing sounds in a volume range different from a respective volume range of each other ambient noise signal;

generating a weight for each ambient noise component; and

providing, as the combination of the ambient noise and the external audio signal, a combination of the external audio signal with the ambient noise components weighted according to the generated weight for each ambient noise component.

Assignments (14)