Acoustic localization of a speaker
View Patent ↗A system locates a speaker in a room containing a loudspeaker and a microphone array. The loudspeaker transmits a sound that is partly reflected by a speaker. The microphone array detects the reflected sound and converts the sound into a microphone signal. A processor determines the speaker's direction relative to the microphone array, the speaker's distance from the microphone array, or both, based on the characteristics of the microphone signals.
1. A method for localizing a speaker in a room in which at least one loudspeaker and at least one microphone array are located, the method comprising:
outputting sound by the at least one loudspeaker such that the sound is at least partly reflected by the speaker;
detecting the sound output by the at least one loudspeaker and at least partly reflected by the speaker by the microphone array to obtain a microphone signal; and
determining the speaker's direction towards and/or distance from the microphone array based on the microphone signals.
2. The method according to claim 1 , further comprising beamforming the microphone signals to obtain at least one beamformed signal, and where the speaker's direction towards or distance from the microphone array is determined based on the at least one beamformed signal.
3. The method according to claim 2 , further comprising estimating impulse responses of a system comprising the at least one loudspeaker, the room, and the microphone array for at least some of the beamformed signals, and where the speaker's direction towards or distance from the microphone array is determined based on the estimated impulse responses.
4. The method according to claim 1 , wherein the sound is sequentially output by a loudspeaker array in a respective one of a number of predetermined directions; and where the microphone array is steered to a respective one of a number of predetermined directions to obtain a beamformed signal for the respective one of the predetermined directions; and the method further comprising:
estimating impulse responses of a system comprising the loudspeaker array, the room, and the microphone array for at least some of the beamformed signals, and where the speaker's direction towards or distance from the microphone array is determined based on the estimated impulse responses.
5. The method according to claim 1 , further comprising:
estimating the impulse responses of a system comprising the at least one loudspeaker, the room, and the microphone array for at least some of the microphone signals; and
beamforming the estimated impulse responses to obtain at least one beamformed impulse response, and where the speaker's direction towards or distance from the microphone array is determined based on the at least one beamformed impulse response.
6. The method according to claim 3 , further comprising:
determining energy responses from the estimated impulse responses; and
generating a direction-distance diagram based on the determined energy responses, and where the speaker's direction towards or distance from the microphone array is determined based on the direction-distance diagram.
7. The method according to claim 5 , further comprising:
determining energy responses from the beamformed impulse responses; and
generating a direction-distance diagram based on the determined energy responses, and where the speaker's direction towards or distance from the microphone array is determined based on the direction-distance diagram.
8. The method according to claim 6 , further comprising passing the estimated impulse responses within a frequency range to obtain filtered impulse responses, and where the energy responses are determined from the filtered impulse responses.
9. The method according to claim 7 , further comprising passing the beamformed impulse responses within a frequency band to obtain filtered beamformed impulse responses, and where the energy responses are determined from the filtered beamformed impulse responses.
10. The method according to claim 6 , further comprising determining local maxima of the direction-distance diagram, and where the speaker's direction towards and/or distance from the microphone array is determined based on the determined local maxima.
11. The method according to claim 6 , further comprising generating a reference direction-distance diagram and subtracting the direction-distance diagram and the reference direction-distance diagram from each other to obtain a differential direction-distance diagram, and where the speaker's direction towards or distance from the microphone array is determined based on the differential direction-distance diagram.
12. The method according to claim 11 , further comprising determining local maxima of the differential direction-distance diagram; and where the speaker's direction towards or distance from the microphone array is determined based on the determined local maxima.
13. The method of claim 1 , further comprising:
detecting vocalization sounds including sounds generated by the speaker based on the speaker's direction towards and/or distance from the microphone array; and
processing the vocalization sounds.
14. The method of claim 1 , where processing the vocalization sounds includes performing voice recognition on the vocalization sounds.