Acoustic localization of a speaker
A system locates a speaker in a room containing a loudspeaker and a microphone array. The loudspeaker transmits a sound that is partly reflected by a speaker. The microphone array detects the reflected sound and converts the sound into a microphone array, the speaker's distance from the microphone array, or both, based on the characteristics of the microphone signals.
1. A communication system adapted for a localization of a speaker in a room comprising:
at least one loudspeaker configured to output sound such that the sound is at least partly reflected by the speaker;
a microphone array configured to:
detect the sound output by the at least one loudspeaker and reflected by the speaker, the sound output by the at least one loudspeaker in a direct path to the microphone array, and the sound output by the at least one loudspeaker and reflected by a surface other than the speaker; and
obtain microphone signals for each microphone comprising the microphone array;
a beamformer configured to obtain at least one beamformed signal from the microphone signals;
a filter configured to estimate, using the at least one beamformed signal, an impulse response of a system comprising the at least one loudspeaker, the room, and the microphone array;
wherein the impulse response is determined based on the at least one loudspeaker, the room, and the microphone array; and
a processor programmed to determine the speaker's direction towards and/or distance from the microphone array based on the estimated impulse responses.
2. The communication system according to claim 1 , further comprising:
a loudspeaker array, including the at least one loudspeaker, configured to sequentially output sound in a number of predetermined directions; and
a controller configured to control the loudspeaker array to sequentially output the sound in a respective one of the number of predetermined directions and to simultaneously steer the microphone array to the respective one of the number of predetermined directions to obtain a beamformed signal for each of the predetermined directions, and where the filter is configured to estimate an impulse response of a system comprising the loudspeaker array, the room, and the microphone array for the obtained beamformed signals.
3. The communication system according to claim 1 , where the processor is further configured to:
determine energy responses from each of the estimated impulse responses; and
generate a direction-distance diagram based on the determined energy responses; and
determine the speaker's direction towards or distance from the microphone array based on the generated direction-distance diagram by determining a local maxima in the direction-distance diagram.
4. A communication system adapted for a localization of a speaker in a room comprising:
at least one loudspeaker configured to output sound such that the sound is at least partly reflected by the speaker;
a microphone array configured to detect the sound output by the at least one loudspeaker and reflected by the speaker, the sound output by the at least one loudspeaker in a direct path to the microphone array, and the sound output by the at least one loudspeaker and reflected by a surface other than the speaker; and to
obtain microphone signals for each of a plurality of microphones comprising the microphone array;
a filter configured to estimate impulse responses of a system comprising the at least one loudspeaker, the room, and the microphone array for at least some of the microphone signals;
wherein the impulse response is determined based on the at least one loudspeaker, the room, and the microphone array;
a beamformer configured to beamform the estimated impulse responses to obtain at least one beamformed impulse response; and
a processor programmed to determine the speaker's direction towards Of and distance from the microphone array based on the at least one beamformed impulse response.
5. The communication system according to claim 4 , where the processor is further programmed to:
determine energy responses from each of the beamformed impulse responses;
generate a direction-distance diagram based on the determined energy responses; and
determine the speaker's direction towards or distance from the microphone array based on the generated direction-distance diagram by determining a local maxima in the direction-distance diagram.
6. The communication system of claim 4 , where the at least one loudspeaker, the microphone array, the filter, the beamformer, and the processor comprise a hands-free set.
7. The communication system of claim 4 , where the at least one loudspeaker, the microphone array, the filter, the beamformer, and the processor comprise an audio or video conference system.
8. The communication system of claim 4 , where the at least one loudspeaker, the microphone array, the filter, the beamformer, and the processor comprise a speech controller.
9. The communication system of claim 4 , where the at least one loudspeaker, the microphone array, the filter, the beamformer, and the processor comprise a speech recognition device.
10. A method localization of a speaker in a room, comprising:
receiving microphone signals for each microphone in a microphone array, wherein the microphone array detects sound output by at least one loudspeaker and at least partly reflected by the speaker, sound output by the at least one loudspeaker in a direct path to the microphone array, and sound output by the at least one loudspeaker and reflected by a surface other than the speaker; and
obtaining at least one beamformed signal from the microphone signals;
estimating, using the at least one beamformed signal, an impulse response of a system comprising the at least one loudspeaker, the room, and the microphone array, wherein the impulse response is determined based on the at least one loudspeaker, the room, and the microphone array; and
determining, using a computer processor, the speaker's direction towards and/or distance from the microphone array based on the estimated impulse responses.
11. The method according to claim 10 , further comprising:
processing sound from a loudspeaker array, including the at least one loudspeaker, that is sequentially output in a number of predetermined directions; and
controlling the loudspeaker array to sequentially output the sound in a respective one of the number of predetermined directions and to simultaneously steer the microphone array to the respective one of the number of predetermined directions to obtain a beamformed signal for each of the predetermined directions, and where the filter is configured to estimate an impulse response of a system comprising the loudspeaker array, the room, and the microphone array for the obtained beamformed signals.
12. The method according to claim 11 , further comprising:
determining energy responses from each of the estimated impulse responses; and
generating a direction-distance diagram based on the determined energy responses; and
determining the speaker's direction towards or distance from the microphone array based on the generated direction-distance diagram by determining a local maxima in the direction-distance diagram.