IP Library › Granted Patent US 9,338,549
Granted Patent B2
US 9,338,549 · App. 13/478,941 · Granted May 10, 2016

Acoustic localization of a speaker

Inventors: Tim Haulick (Blaubeuren, DE); Gerhard Uwe Schmidt (Ulm, DE); Markus Buck (Biberach, DE); Tobias Wolff (Ulm, DE)
Assignee: NUANCE COMMUNICATIONS, INC.
H04R3/005G01S3/808G01S3/8083G01S5/30G01S7/52003G01S15/00G01S15/003G01S15/42G01S15/876H04R1/40H04R1/406H04S7/00H04S7/30G01S3/00G01S3/043G01S3/802G01S5/0252G01S5/0273G01S5/18G01S7/292G01S7/523G01S13/003G01S13/42G01S15/06G10K11/34G10K15/08H04B7/086H04M1/6075H04R29/00H04R29/001H04R2201/401H04R2201/403H04R2203/12H04R2410/01H04R2430/20H04R2499/11H04S7/301H04S7/302H04S7/303H04S7/305
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,338,549
App. No.
13/478,941
Granted
May 10, 2016
Kind
B2
Abstract

A system locates a speaker in a room containing a loudspeaker and a microphone array. The loudspeaker transmits a sound that is partly reflected by a speaker. The microphone array detects the reflected sound and converts the sound into a microphone array, the speaker's distance from the microphone array, or both, based on the characteristics of the microphone signals.

Claims (44)

1. A communication system adapted for a localization of a speaker in a room comprising:

at least one loudspeaker configured to output sound such that the sound is at least partly reflected by the speaker;

a microphone array configured to:

detect the sound output by the at least one loudspeaker and reflected by the speaker, the sound output by the at least one loudspeaker in a direct path to the microphone array, and the sound output by the at least one loudspeaker and reflected by a surface other than the speaker; and

obtain microphone signals for each microphone comprising the microphone array;

a beamformer configured to obtain at least one beamformed signal from the microphone signals;

a filter configured to estimate, using the at least one beamformed signal, an impulse response of a system comprising the at least one loudspeaker, the room, and the microphone array;

wherein the impulse response is determined based on the at least one loudspeaker, the room, and the microphone array; and

a processor programmed to determine the speaker's direction towards and/or distance from the microphone array based on the estimated impulse responses.

2. The communication system according to claim 1 , further comprising:

a loudspeaker array, including the at least one loudspeaker, configured to sequentially output sound in a number of predetermined directions; and

a controller configured to control the loudspeaker array to sequentially output the sound in a respective one of the number of predetermined directions and to simultaneously steer the microphone array to the respective one of the number of predetermined directions to obtain a beamformed signal for each of the predetermined directions, and where the filter is configured to estimate an impulse response of a system comprising the loudspeaker array, the room, and the microphone array for the obtained beamformed signals.

3. The communication system according to claim 1 , where the processor is further configured to:

determine energy responses from each of the estimated impulse responses; and

generate a direction-distance diagram based on the determined energy responses; and

determine the speaker's direction towards or distance from the microphone array based on the generated direction-distance diagram by determining a local maxima in the direction-distance diagram.

4. A communication system adapted for a localization of a speaker in a room comprising:

at least one loudspeaker configured to output sound such that the sound is at least partly reflected by the speaker;

a microphone array configured to detect the sound output by the at least one loudspeaker and reflected by the speaker, the sound output by the at least one loudspeaker in a direct path to the microphone array, and the sound output by the at least one loudspeaker and reflected by a surface other than the speaker; and to

obtain microphone signals for each of a plurality of microphones comprising the microphone array;

a filter configured to estimate impulse responses of a system comprising the at least one loudspeaker, the room, and the microphone array for at least some of the microphone signals;

wherein the impulse response is determined based on the at least one loudspeaker, the room, and the microphone array;

a beamformer configured to beamform the estimated impulse responses to obtain at least one beamformed impulse response; and

a processor programmed to determine the speaker's direction towards Of and distance from the microphone array based on the at least one beamformed impulse response.

5. The communication system according to claim 4 , where the processor is further programmed to:

determine energy responses from each of the beamformed impulse responses;

generate a direction-distance diagram based on the determined energy responses; and

determine the speaker's direction towards or distance from the microphone array based on the generated direction-distance diagram by determining a local maxima in the direction-distance diagram.

6. The communication system of claim 4 , where the at least one loudspeaker, the microphone array, the filter, the beamformer, and the processor comprise a hands-free set.

7. The communication system of claim 4 , where the at least one loudspeaker, the microphone array, the filter, the beamformer, and the processor comprise an audio or video conference system.

8. The communication system of claim 4 , where the at least one loudspeaker, the microphone array, the filter, the beamformer, and the processor comprise a speech controller.

9. The communication system of claim 4 , where the at least one loudspeaker, the microphone array, the filter, the beamformer, and the processor comprise a speech recognition device.

10. A method localization of a speaker in a room, comprising:

receiving microphone signals for each microphone in a microphone array, wherein the microphone array detects sound output by at least one loudspeaker and at least partly reflected by the speaker, sound output by the at least one loudspeaker in a direct path to the microphone array, and sound output by the at least one loudspeaker and reflected by a surface other than the speaker; and

obtaining at least one beamformed signal from the microphone signals;

estimating, using the at least one beamformed signal, an impulse response of a system comprising the at least one loudspeaker, the room, and the microphone array, wherein the impulse response is determined based on the at least one loudspeaker, the room, and the microphone array; and

determining, using a computer processor, the speaker's direction towards and/or distance from the microphone array based on the estimated impulse responses.

11. The method according to claim 10 , further comprising:

processing sound from a loudspeaker array, including the at least one loudspeaker, that is sequentially output in a number of predetermined directions; and

controlling the loudspeaker array to sequentially output the sound in a respective one of the number of predetermined directions and to simultaneously steer the microphone array to the respective one of the number of predetermined directions to obtain a beamformed signal for each of the predetermined directions, and where the filter is configured to estimate an impulse response of a system comprising the loudspeaker array, the room, and the microphone array for the obtained beamformed signals.

12. The method according to claim 11 , further comprising:

determining energy responses from each of the estimated impulse responses; and

generating a direction-distance diagram based on the determined energy responses; and

determining the speaker's direction towards or distance from the microphone array based on the generated direction-distance diagram by determining a local maxima in the direction-distance diagram.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2013
From: HAULICK, TIM; SCHMIDT, GERHARD UWE; BUCK, MARKUS; WOLFF, TOBIAS
To: HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH
Reel/Frame 030170/0407 →
ASSET PURCHASE AGREEMENT Recorded Apr 8, 2013
From: HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 030174/0010 →
Priority Claims (1)
EP 07007817 · Apr 17, 2007 · regional
Continuity (2)
Division 12104836 · Apr 17, 2008
Related Publication 20120294118A1 · Nov 22, 2012