IP Library Granted Patent US 9,414,159
Granted Patent B2
US 9,414,159 · App. 14/176,351 · Granted Aug 9, 2016

Beamforming pre-processing for speaker localization

Inventors: Tobias Wolff (Ulm, DE); Markus Buck (Biberach, DE); Gerhard Uwe Schmidt (Ulm, DE)
Assignee: NUANCE COMMUNICATIONS, INC.
H04R3/005H04R2430/20H04R2430/23
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,414,159
App. No.
14/176,351
Granted
Aug 9, 2016
Kind
B2
Abstract

Methods and apparatus to beamform a first plurality of microphone signals using at least one beamforming weight to obtain a first beamformed signal, beamform a second plurality of microphone signals using the at least one beamforming weight to obtain a second beamformed signal, and adjust the at least one beamforming weight so that the power density of at least one perturbation component present in the first or the second plurality of microphone signals is reduced.

Claims (30)

1. A method comprising:

beamforming a first plurality of microphone signals using at least one beamforming weight to obtain a first beamformed signal;

beamforming a second plurality of microphone signals using the at least one beamforming weight to obtain a second beamformed signal; and

adjusting the at least one beamforming weight so that the power density of at least one perturbation component present in the first or the second plurality of microphone signals is reduced.

2. The method according to claim 1 , further comprising receiving the first plurality of microphone signals from a first microphone array and receiving the second plurality of microphone signals from a second microphone array, wherein the first microphone array and the second microphone array share at least one microphone.

3. The method according to claim 1 , wherein the at least one perturbation component comprises a noise component.

4. The method according to claim 1 , wherein the at least one perturbation component comprises an echo component.

5. The method according to claim 1 , further including performing speaker localization from the first and/or second microphone signals.

6. The method according to claim 5 , further including determining a direction of the speaker with respect to a first microphone array providing the first microphone signals and/or a second microphone array providing the second microphone signals.

7. The method according to claim 5 , further including determining a distance of the speaker with respect to a first microphone array providing the first microphone signals and/or a second microphone array providing the second microphone signals.

8. The method according to claim 1 , further including performing calibration with no wanted signal present, wherein a wanted signal corresponds to a speech utterance.

9. The method according to claim 8 , further including performing the calibration prior to the speech utterance being present.

10. The method according to claim 8 , further including performing the calibration during speech pauses.

11. An article, comprising:

a non-transitory computer readable storage medium having stored instructions that enable a machine to:

beamform a first plurality of microphone signals using at least one beamforming weight to obtain a first beamformed signal;

beamform a second plurality of microphone signals using the at least one beamforming weight to obtain a second beamformed signal; and

adjust the at least one beamforming weight so that the power density of at least one perturbation component present in the first or the second plurality of microphone signals is reduced.

12. The article according to claim 11 , further comprising instructions to receive the first plurality of microphone signals from a first microphone array and receive the second plurality of microphone signals from a second microphone array, wherein the first microphone array and the second microphone array share at least one microphone.

13. The article according to claim 11 , wherein the at least one perturbation component comprises a noise component.

14. The article according to claim 11 , wherein the at least one perturbation component comprises an echo component.

15. The article according to claim 11 , further including instructions to perform speaker localization from the first and/or second microphone signals.

16. The article according to claim 15 , further including instructions to determine a direction of the speaker with respect to a first microphone array providing the first microphone signals and/or a second microphone array providing the second microphone signals.

17. The article according to claim 15 , further including instructions to determine a distance of the speaker with respect to a first microphone array providing the first microphone signals and/or a second microphone array providing the second microphone signals.

18. The article according to claim 15 , further including instructions to perform calibration with no wanted signal present, wherein a wanted signal corresponds to a speech utterance.

19. The article according to claim 18 , further including instructions to perform the calibration prior to the speech utterance being present.

20. A system, comprising:

a first beamformer module to receive a first plurality of microphone signals using at least one beamforming weight to obtain a first beamformed signal;

a second beamformer module to receive a second plurality of microphone signals using the at least one beamforming weight to obtain a second beamformed signal; and

a control module, which includes a processor, to adjust the at least one beamforming weight so that the power density of at least one perturbation component present in the first or the second plurality of microphone signals is reduced.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2014
From: WOLFF, TOBIAS; BUCK, MARKUS; SCHMIDT, GERHARD
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 032188/0794 →
Priority Claims (1)
EP 08012866 · Jul 16, 2008 · regional
Continuity (2)
Continuation 12504333 · Jul 16, 2009
Related Publication 20140153740A1 · Jun 5, 2014