IP Library Granted Patent US 9,215,543
Granted Patent B2
US 9,215,543 · App. 14/095,180 · Granted Dec 15, 2015

Microphone mute/unmute notification

Inventors: Haohai Sun (Sandvika, NO); Bjorn Winsvold (Tranby, NO)
Assignee: Cisco Technology, Inc.
H04R29/008G06K9/00221G10L25/48H04L12/1822H04M3/56H04N7/15H04R29/004G10L25/78G10L2021/02166
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,215,543
App. No.
14/095,180
Granted
Dec 15, 2015
Kind
B2
Abstract

A processing system can include a processor that includes circuitry. The circuitry can be configured to: receive far-end and near-end audio signals; detect silence events and voice activities from the audio signals; determine whether an audio event in the audio signals is an interference event or a speaker event based on the detected silence events and voice activities, and further based on localized acoustic source data and faces or motion detected from an image; and generate a mute or unmute indication based on whether the audio event is the interference event or the speaker event. The system can include a near-end microphone array to output the near-end audio signals, one or more far-end microphones to output the far-end audio signals, and one or more cameras to capture the image of the environment.

Claims (56)

1. A processor, comprising circuitry configured to:

receive far-end and near-end audio signals;

detect voice activities from the audio signals using a voice activity detection algorithm;

detect sound activities from the audio signals using a sound activity detection algorithm;

detect a sound position from the audio signals using an acoustic source localization algorithm;

receive data indicative of a region of interest;

when the voice activity detection algorithm indicates voice activities at a same time that the sound activity detection algorithm indicates sound activities, determine whether the sound position is in the region of interest;

determine that an audio event in the audio signals is an interference event in response to the sound position being outside of the region of interest; and

generate a mute or unmute indication based on whether the audio event being the interference event.

2. The processor according to claim 1 , wherein the circuitry is further configured to display the mute or unmute indication.

3. The processor according to claim 2 , wherein the circuitry is further configured to receive a mute or unmute operation from a user and execute a corresponding mute or unmute state change.

4. The processor according to claim 3 , wherein the circuitry is further configured to execute a mute or unmute state change corresponding to the mute or unmute indication after a predetermined amount of time has lapsed during which no mute or unmute operation from a user is received.

5. The processor according to claim 2 , wherein the circuitry is further configured to execute a mute or unmute state change corresponding to the mute or unmute without receiving a mute or unmute operation from a user.

6. The processor according to claim 1 , wherein the region of interest is defined by a face detection circuit that detects faces from an image of the environment.

7. The processor according to claim 1 , wherein the circuitry is further configured to cancel and/or suppress acoustic echo and reduce noise from the acoustic signals.

8. The processor according to claim 1 , wherein the circuitry is further configured to jointly utilize acoustic source localization, acoustic echo cancellation, noise reduction, and face detection to classify near-end events.

9. The processor according to claim 8 , wherein the near-end events include silence events, interference events, and speaker events.

10. The processor according to claim 9 , wherein the circuitry is configured to generate the mute or unmute indication based on whether a current near-end event of the near-end events is a silence event, an interference event, or speaker event.

11. The processor according to claim 1 , wherein the circuitry is configured to:

process the acoustic signals for each of a plurality of sequential short-time frames, each having a frame length of 100 ms or less, and

determine a near-end event for each of the frames.

12. The processor according to claim 11 , wherein the frame length is 10 ms to 100 ms.

13. The processor according to claim 1 , wherein the circuitry is further configured to:

receive images of the environment that are captured by cameras, and

detect the faces or motion in the images.

14. The processor according to claim 1 , wherein the circuitry is further configured to:

receive the near-end acoustic signals from an array of microphones, and

determine sound source positions, as the localized acoustic source data, from the near-end acoustic signals.

15. The processor according to claim 1 , wherein the circuitry is further configured to:

determine that an audio event in the audio signals is a speaker event in response to the sound position being inside of the region of interest.

16. A processing system, comprising:

a processor including circuitry configured to:

receive far-end and near-end audio signals;

detect voice activities from the audio signals using a voice activity detection algorithm;

detect sound activities from the audio signals using a sound activity detection algorithm;

detect a sound position from the audio signals using an acoustic source localization algorithm;

receive data indicative of a region of interest;

when the voice activity detection algorithm indicates voice activities at a same time that the sound activity detection algorithm indicates sound activities, determine whether the sound position is in the region of interest;

determine that an audio event in the audio signals is an interference event in response to the sound position being outside of the region of interest; and

generate a mute or unmute indication based the audio event being interference event,

a near-end microphone array to output the near-end audio signals,

one or more far-end microphones to output the far-end audio signals, and

one or more cameras to capture the image of the environment including the region of interest.

17. The processing system according to claim 16 , further comprising:

a display to display the mute or unmute indication.

18. The processing system according to claim 16 , further comprising:

a user-interface to accept a user operation to change a mute or unmute state of the processing system.

19. A method, comprising:

receiving far-end and near-end audio signals;

detecting voice activities from the audio signals using a voice activity detection algorithm;

detecting sound activities from the audio signals using a sound activity detection algorithm;

detecting a sound position from the audio signals using an acoustic source localization algorithm;

receiving data indicative of a region of interest;

when the voice activity detection algorithm indicates voice activities at a same time that the sound activity detection algorithm indicates sound activities, determining whether the sound position is in the region of interest;

determining that an audio event in the audio signals is an interference event in response to the sound position being outside of the region of interest; and

generating a mute or unmute indication based on the audio event being the interference event.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2013
From: SUN, HAOHAI; WINSVOLD, BJORN
To: CISCO TECHNOLOGY, INC.
Reel/Frame 031705/0949 →
Continuity (1)
Related Publication 20150156598A1 · Jun 4, 2015