IP Library Patent Application 14662022
Patent Application
App. No. 14/662,022

STRUCTURE FOR MULTI-MICROPHONE SPEECH ENHANCEMENT SYSTEM

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
14/662,022
Abstract

Embodiments are directed towards enhancing speech and noise reduction for audio signals. Each of a plurality of microphones may generate a plurality of audio signals based on sound sensed in a physical space. One of the plurality of audio signals may be designated as a primary channel and each other audio signal of the plurality of audio signals may be designated as secondary channels. Acoustic echo cancellation is performed on the primary channel to generate an echo canceled signal. Noise reduction (e.g., employing a multi-microphone beamformer) is performed on the primary channel and the secondary channels to generate a noise reduced signal. In various embodiments, the noise reduction is performed in parallel with the acoustic echo cancellation. An enhanced audio signal may be generated based on a combination of the echo canceled signal and the noise reduced signal.

Claims (55)

1 . A method for enhancing speech and noise reduction for audio signals, comprising:

employing each of a plurality of microphones to generate a plurality of audio signals based on sound sensed in a physical space, wherein one of the plurality of audio signals is a primary channel and each other audio signal of the plurality of audio signals are secondary channels;

performing acoustic echo cancellation on the primary channel to generate an echo canceled signal;

performing noise reduction on the primary channel and the secondary channels to generate a noise reduced signal, wherein the noise reduction is performed in parallel with the acoustic echo cancellation; and

generating an enhanced audio signal based on a combination of the echo canceled signal and the noise reduced signal.

2 . The method of claim 1 , wherein generating the enhanced audio signal further comprises:

employing a gain mapping on the noise reduced signal compared to the primary channel; and

combining the mapped gain with the echo canceled signal to generate the enhanced audio signal.

3 . The method of claim 1 , further comprising:

determining the primary channel as an audio signal generated from a microphone that corresponds to an active beam zone within the physical space, wherein the plurality of microphones are arranged to logically define the physical space into a plurality of beam zones.

4 . The method of claim 1 , further comprising:

determining the secondary channels as audio signals are generated by one or more microphones that correspond to inactive beam zones within the physical space, wherein the plurality of microphones are arranged to logically define the physical space into a plurality of beam zones.

5 . The method of claim 1 , wherein performing noise reduction on the primary channel and the secondary channels, further comprises, employing a multi-microphone beamformer to generate the noise reduced signal.

6 . The method of claim 1 , wherein performing noise reduction on the primary channel and the secondary channels, further comprises:

employing a multi-microphone beamformer for each of a plurality of beam zones;

employing a separate gain mapping on each output from each multi-microphone beamformer to generate a mapped gain for each beam zone; and

selecting a final mapped gain from the mapped gain for each beam zone based on an active zone in the plurality of beam zones.

7 . The method of claim 1 , wherein performing noise reduction on the primary channel and the secondary channels to generate the noise reduced signal, further comprises, employing single microphone noise reduction on the primary channel without the secondary channels.

8 . A computer for enhancing speech and noise reduction for audio signals, comprising:

a memory for storing at least instructions; and

a processor that executes the instructions to perform actions, including:

employing each of a plurality of microphones to generate a plurality of audio signals based on sound sensed in a physical space, wherein one of the plurality of audio signals is a primary channel and each other audio signal of the plurality of audio signals are secondary channels;

performing acoustic echo cancellation on the primary channel to generate an echo canceled signal;

performing noise reduction on the primary channel and the secondary channels to generate a noise reduced signal, wherein the noise reduction is performed in parallel with the acoustic echo cancellation; and

generating an enhanced audio signal based on a combination of the echo canceled signal and the noise reduced signal.

9 . The computer of claim 8 , wherein generating the enhanced audio signal further comprises:

employing a gain mapping on the noise reduced signal compared to the primary channel; and

combining the mapped gain with the echo canceled signal to generate the enhanced audio signal.

10 . The computer of claim 8 , wherein the processor that executes the instructions performs further actions, comprising:

determining the primary channel as an audio signal generated from a microphone that corresponds to an active beam zone within the physical space, wherein the plurality of microphones are arranged to logically define the physical space into a plurality of beam zones.

11 . The computer of claim 8 , wherein the processor that executes the instructions performs further actions, comprising:

determining the secondary channels as audio signals are generated by one or more microphones that correspond to inactive beam zones within the physical space, wherein the plurality of microphones are arranged to logically define the physical space into a plurality of beam zones.

12 . The computer of claim 8 , wherein performing noise reduction on the primary channel and the secondary channels, further comprises, employing a multi-microphone beamformer to generate the noise reduced signal.

13 . The computer of claim 8 , wherein performing noise reduction on the primary channel and the secondary channels, further comprises:

employing a multi-microphone beamformer for each of a plurality of beam zones;

employing a separate gain mapping on each output from each multi-microphone beamformer to generate a mapped gain for each beam zone; and

selecting a final mapped gain from the mapped gain for each beam zone based on an active zone in the plurality of beam zones.

14 . The computer of claim 8 , wherein performing noise reduction on the primary channel and the secondary channels to generate the noise reduced signal, further comprises, employing single microphone noise reduction on the primary channel without the secondary channels.

15 . A processor readable non-transitory storage media that includes instructions to enhance speech and noise reduction for audio signals, wherein the execution of the instructions by a processor performs actions, comprising:

employing each of a plurality of microphones to generate a plurality of audio signals based on sound sensed in a physical space, wherein one of the plurality of audio signals is a primary channel and each other audio signal of the plurality of audio signals are secondary channels;

performing acoustic echo cancellation on the primary channel to generate an echo canceled signal;

performing noise reduction on the primary channel and the secondary channels to generate a noise reduced signal, wherein the noise reduction is performed in parallel with the acoustic echo cancellation; and

generating an enhanced audio signal based on a combination of the echo canceled signal and the noise reduced signal.

16 . The media of claim 15 , wherein generating the enhanced audio signal further comprises:

employing a gain mapping on the noise reduced signal compared to the primary channel; and

combining the mapped gain with the echo canceled signal to generate the enhanced audio signal.

17 . The media of claim 15 , further comprising:

determining the primary channel as an audio signal generated from a microphone that corresponds to an active beam zone within the physical space, wherein the plurality of microphones are arranged to logically define the physical space into a plurality of beam zones.

18 . The media of claim 15 , further comprising:

determining the secondary channels as audio signals are generated by one or more microphones that correspond to inactive beam zones within the physical space, wherein the plurality of microphones are arranged to logically define the physical space into a plurality of beam zones.

19 . The media of claim 15 , wherein performing noise reduction on the primary channel and the secondary channels, further comprises, employing a multi-microphone beamformer to generate the noise reduced signal.

20 . The media of claim 15 , wherein performing noise reduction on the primary channel and the secondary channels, further comprises:

employing a multi-microphone beamformer for each of a plurality of beam zones;

employing a separate gain mapping on each output from each multi-microphone beamformer to generate a mapped gain for each beam zone; and

selecting a final mapped gain from the mapped gain for each beam zone based on an active zone in the plurality of beam zones.

Assignments (3)
CHANGE OF NAME Recorded Feb 29, 2016
From: CAMBRIDGE SILICON RADIO LIMITED
To: QUALCOMM TECHNOLOGIES INTERNATIONAL, LTD.
Reel/Frame 037853/0185 →
CHANGE OF NAME Recorded Jan 13, 2016
From: CAMBRIDGE SILICON RADIO LIMITED
To: QUALCOMM TECHNOLOGIES INTERNATIONAL, LTD.
Reel/Frame 037482/0770 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2015
From: YU, TAO; ALVES, ROGERIO GUEDES
To: CAMBRIDGE SILICON RADIO LIMITED
Reel/Frame 035196/0252 →