IP Library Granted Patent US 9,488,716
Granted Patent B2
US 9,488,716 · App. 14/145,196 · Granted Nov 8, 2016

Microphone autolocalization using moving acoustic source

Inventors: Nikolay D. Gaubitch (Delft, NL); Willem Bastiaan Kleijn (Lower Hutt, NZ); Richard Heusdens (Delft, NL)
Assignee: GOOGLE INC.
G01S5/18G01S5/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,488,716
App. No.
14/145,196
Filed
Dec 31, 2013
Granted
Nov 8, 2016
Kind
B2
Art Unit
3645
USPC
367/13
Abstract

Provided are methods and systems for calibrating a distributed sensor (e.g., microphone) array using time-of-flight (TOF) measurements for a plurality of spatially distributed acoustic events at the sensors. The calibration includes localization and gain equalization of the sensors. Accurate measurements of TOFs are obtained from spatially distributed acoustic events using a controlled signal emitted at known intervals by a moving acoustic source. A portable user device capable of playing out audio is used to produce a plurality of acoustic events (e.g., sound clicks) at known intervals of time and at different, but arbitrary locations based on the device being moved around in space by a user while producing the acoustic events. As such, the times of the acoustic event generation are known, and are spatially diverse. The calibration signals emitted by the acoustic source are designed to provide robustness to noise and reverberation.

Claims (28)

1. A computer-implemented method comprising:

determining registered arrival times of a set of acoustic events at a set of sensors, wherein the acoustic events are generated at time intervals known to the sensors;

calculating times of flight for the acoustic events to reach the sensors based on the registered arrival times of the acoustic events at the sensors, event generation times for the acoustic events, and estimated internal delays of the sensors; and

using the calculated times of flight to determine locations of the sensors.

2. The method of claim 1 , wherein, for each sensor, the time of flight for the acoustic event to reach the sensor is calculated by subtracting, from the registered arrival time for the sensor, the internal delay of the sensor and the event generation time for the acoustic event.

3. The method of claim 1 , wherein calculating the times of flight for the acoustic events to reach the sensors is performed iteratively to refine the times of flight.

4. The method of claim 1 , further comprising selecting the first acoustic event generated as a reference time for calculating the times of flight for the acoustic events to reach the sensors.

5. The method of claim 1 , further comprising determining a relative gain for each of the sensors using the calculated location of the sensor and the registered arrival times of the events at the sensor.

6. The method of claim 1 , wherein each of the acoustic events is a calibration signal that is a Gaussian modulated sinusoidal pulse.

7. The method of claim 1 , wherein each of the acoustic events is a calibration signal that is a time-stretched pulse.

8. The method of claim 1 , wherein each of the acoustic events is a calibration signal that is a unit impulse.

9. The method of claim 1 , wherein the set of sensors is a set of microphones.

10. The method of claim 1 , wherein the set of events is generated by a device with a loudspeaker from a plurality of different locations relative to the sensors.

11. The method of claim 1 , wherein one or more of the sensors are microphones located on mobile telephones.

12. A computer-implemented method comprising:

calculating times of flight for a set of acoustic events to reach a set of sensors based on registered arrival times of the acoustic events at the sensors, event generation times for the acoustic events, and estimated internal delays of the sensors, wherein the acoustic events are generated at time intervals known to the sensors;

calculating locations of the sensors using the times of flight for the acoustic events to reach the sensors; and

determining a relative gain for each of the sensors using the calculated location of the sensor and the registered arrival times of the events at the sensor.

13. The method of claim 12 , further comprising:

measuring arrival times of the set of acoustic events at the set of sensors; and

estimating internal delays of the sensors based on the registered arrival times of the acoustic events at the sensors.

14. The method of claim 12 , wherein calculating the times of flight for the acoustic events to reach the sensors is performed iteratively to refine the times of flight.

15. The method of claim 12 , further comprising selecting the first acoustic event generated as a reference time for calculating the times of flight for the acoustic events to reach the sensors.

16. The method of claim 12 , wherein the relative gain for each of the sensors is determined based on an estimation of the signal-to-noise (SNR) at the sensor.

17. The method of claim 12 , wherein each of the acoustic events is a calibration signal that is a Gaussian modulated sinusoidal pulse.

18. The method of claim 12 , wherein each of the acoustic events is a calibration signal that is a time-stretched pulse.

19. The method of claim 12 , wherein each of the acoustic events is a calibration signal that is a unit impulse.

20. The method of claim 1 , wherein the set of sensors is a set of microphones and the set of events is generated by a device with a loudspeaker from a plurality of different locations relative to the microphones.

Assignments (2)
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2014
From: GAUBITCH, NIKOLAY D.; KLEIJN, WILLEM BASTIAAN; HEUSDENS, RICHARD
To: GOOGLE INC.
Reel/Frame 032107/0226 →
Continuity (1)
Related Publication 20150185312A1 · Jul 2, 2015