IP Library Granted Patent US 9,002,028
Granted Patent B2
US 9,002,028 · App. 14/254,007 · Granted Apr 7, 2015

Noisy environment communication enhancement system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,002,028
App. No.
14/254,007
Granted
Apr 7, 2015
Kind
B2
Abstract

A communication system enhances communications in a noisy environment. Multiple input arrays convert a voiced or unvoiced signal into an analog signal. A converter receives the analog signal and generates digital signals. A digital signal processor determines temporal and spatial information from the digital signals. The processed signals are then converted to audible sound.

Claims (35)

1. A method, comprising:

receiving input signals from at least two microphone arrays each comprising at least two microphones to generate microphone signals;

supplying the microphone signals to a beamformer comprising a wanted signal beamformer and a blocking beamformer,

in the wanted signal beamformer, combining the microphone signals with a computer processor such that signals from a wanted direction corresponding to a first one of the microphone arrays and a given speaker are transmitted substantially without attenuation and signal components of directions other than the wanted direction are substantially attenuated; and

in the blocking beamformer, substantially suppressing at least one of the microphone signals from the wanted signal direction, and transmitting with minimum distortion at least one of the microphone signals from directions other than the wanted direction.

2. The method according to claim 1 , further including identifying potential feedback frequencies and placing adaptive notch filters at the potential feedback frequencies.

3. The method according to claim 1 , further including attenuating one of the microphones associated with non-active speakers for mitigating double-talk effects.

4. The method according to claim 1 , further including comparing powers of signal outputs from the wanted signal beamformer and the blocking beamformer to determine a given one of a plurality of speech scenarios.

5. The method according to claim 4 , wherein the plurality of speech scenarios include no speakers, one speaker, and one speaker located not in the wanted direction.

6. The method according to claim 1 , further including enhancing the directivity of the wanted signal beamformer with an adaptive beamformer.

7. The method according to claim 6 , wherein the adaptive beamformer comprises a general sidelobe canceller.

8. The method according to claim 6 , further including adapting the adaptive beamformer only when no signal from the wanted signal direction is transmitted.

9. The method according to claim 1 , further including detecting whether there are one or more speakers are active and outputting signals for the active speakers to loudspeakers.

10. The method according to claim 1 , further including performing automatic gain control outputs of the beamformer based on distance between speakers and microphones.

11. The method according to claim 1 , determining an output volume for loudspeakers of signals from the beamformer based upon background noise level.

12. The method according to claim 1 , further comprising detecting speech activity for each microphone array, wherein detecting speech activity for a microphone array comprises:

determining a wanted signal power, a blocking signal power, and a background noise signal power, and

comparing the wanted signal power with the blocking signal power and the background noise signal power.

13. The method according to claim 1 , further comprising selecting at least one output channel out of at least two output channels on which the processed signals are to be output.

14. A system, comprising:

a beamformer to receive input signals from at least two microphone arrays each comprising at least two microphones to generate microphone signals,

wherein the beamformer comprises:

a wanted signal beamformer to combine the microphone signals such that signals from a wanted direction corresponding to a first one of the microphone arrays and a given speaker are transmitted substantially without attenuation and signal components of directions other than the wanted direction are substantially attenuated; and

a blocking beamformer to substantially suppress at least one of the microphone signals from the wanted signal direction, and to transmit with minimum distortion at least one of the microphone signals from directions other than the wanted direction.

15. An article, comprising:

a non-transitory computer readable medium having stored instructions that enable a machine to:

receive input signals from at least two microphone arrays each comprising at least two microphones to generate microphone signals;

supplying the microphone signals to a wanted signal beamformer and a blocking beamformer,

in the wanted signal beamformer, combining the microphone signals such that signals from a wanted direction corresponding to a first one of the microphone arrays and a given speaker are transmitted substantially without attenuation and signal components of directions other than the wanted direction are substantially attenuated; and

in the blocking beamformer, substantially suppressing at least one of the microphone signals from the wanted signal direction, and transmitting with minimum distortion at least one of the microphone signals from directions other than the wanted direction.

16. The article according to claim 15 , further including instructions for identifying potential feedback frequencies and placing adaptive notch filters at the potential feedback frequencies.

17. The article according to claim 15 , further including instructions for attenuating one of the microphones associated with non-active speakers for mitigating double-talk effects.

18. The article according to claim 15 , further including instructions for comparing powers of signal outputs from the wanted signal beamformer and the blocking beamformer to determine a given one of a plurality of speech scenarios.

19. The article according to claim 18 , wherein the plurality of speech scenarios include no speakers, one speaker, and one speaker located not in the wanted direction.

20. The article according to claim 15 , further including instructions for enhancing the directivity of the wanted signal beamformer with an adaptive beamformer.

Assignments (7)
RELEASE (REEL 052935 / FRAME 0584) Recorded Jan 2, 2025
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: CERENCE OPERATING COMPANY
Reel/Frame 069797/0818 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REPLACE THE CONVEYANCE DOCUMENT WITH THE NEW ASSIGNMENT PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 19, 2022
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 059804/0186 →
SECURITY AGREEMENT Recorded Jun 15, 2020
From: CERENCE OPERATING COMPANY
To: WELLS FARGO BANK, N.A.
Reel/Frame 052935/0584 →
RELEASE OF SECURITY INTEREST Recorded Jun 12, 2020
From: BARCLAYS BANK PLC
To: CERENCE OPERATING COMPANY
Reel/Frame 052927/0335 →
SECURITY AGREEMENT Recorded Nov 7, 2019
From: CERENCE OPERATING COMPANY
To: BARCLAYS BANK PLC
Reel/Frame 050953/0133 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE INTELLECTUAL PROPERTY AGREEMENT. Recorded Oct 29, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 050871/0001 →
INTELLECTUAL PROPERTY AGREEMENT Recorded Oct 23, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE INC.
Reel/Frame 050836/0191 →