IP Library Granted Patent US 11,495,243
Granted Patent B2
US 11,495,243 · App. 16/943,250 · Granted Nov 8, 2022

Localization based on time-reversed event sounds

Inventors: Jim Candy (Danville, CA); Karl A. Fisher (Brentwood, CA); Christopher Roland Candy (San Ramon, CA)
Assignee: Lawrence Livermore National Security, LLC
G10L25/48G10L21/04H04L5/0048H04L65/70H04L65/75H04W4/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,495,243
App. No.
16/943,250
Granted
Nov 8, 2022
Kind
B2
Abstract

A system determines an event location of an event within an indoor environment based on an event sound generated by the event. The system employs time-reversal techniques based on a received event sound to identify the event location as being in the vicinity of one of a plurality of locator devices at locator locations in the environment. The system includes a base array located within the environment that receives an indication that an event has been detected. Upon receiving the event sound, the system generates a time-reversed event sound for each transceiver and transmits via each transceiver the time-reversed event sound for that transceiver. When a locator device receives a time-reversed event sound, the locator device determines whether the event is in the vicinity of that locator location of the locator device and, if so, outputs an indication that the event occurred at that locator location.

Claims (40)

1. A method performed by a device for determining an event location of an event within an environment, the method comprising:

receiving, via a receiver of the device, an event sound generated by the event, the received event sound representing event sound that traveled on multiple paths through the environment from the event location to the receiver;

generating, by the device, an encoded time-reversed event sound for the received event sound, the encoded time-reversed event sound being encoded with localization information; and

transmitting, via a transmitter of the device, the encoded time-reversed event sound to a locator that is physically separate from the device,

wherein the event location is in the vicinity of the locator that and the locator recognizes the localization information in the encoded time-reversed event sound that is received by a receiver of the locator.

2. The method of claim 1 wherein the received event sound has portions that are ordered from a first portion received to a last portion received and the generating of the encoded time-reversed event sound orders the portions so that the last portion received is the first portion of the encoded time-reversed event sound and the first portion received is the last portion of the encoded time-reversed event sound.

3. The method of claim 1 wherein the environment is at least partially indoors.

4. The method of claim 1 wherein the generating and transmitting are in response to determining that an event has been detected.

5. The method of claim 1 wherein the generating, for each of a plurality of locators, generates an encoded time-reversed event sound that is encoded with localization information unique to the locator and the transmitting transmits each encoded time-reversed event sound.

6. The method of claim 1 wherein the locators are located at various locations within the environment.

7. The method of claim 1 wherein the event is a gunshot.

8. The method of claim 1 , wherein

the receiving of an event sound generated by the event is a part of receiving the event sound generated by the event via a plurality of transceivers of a base array of transceivers of the device; and

the generating of an encoded time-reversed event sound is a part of generating, for each event sound received by a transceiver of the plurality of transceivers during said receiving, a time-reversed event sound for the event sound received by that transceiver.

9. The method of claim 8 , wherein the transmitting of the encoded time-reversed event sound comprises transmitting, via a transmitter of the device, the encoded time-reversed event sound to a locator that is physically separate from the device.

10. A method performed by one or more computing devices for determining an event location of an event within an environment based on event sound generated by the event, the method comprising:

accessing a sound map of the environment, the sound map having been generated by transmitting pilot signals from a plurality of locations within the environment, receiving the pilot signals by a base array of transceivers, and, for each transceiver of the base array of transceivers, storing a pilot signal received by that transceiver in association with each of the plurality of locations;

receiving, at each transceiver of the base array of transceivers, the event sound generated by the event;

for each location of the plurality of locations,

for each transceiver of the base array of transceivers, generating a correlation score based on the event sound received by the transceiver and the pilot signal of the sound map for that transceiver and that location; and

generating a combined correlation score for that location based on the correlation scores generated for each of the transceivers of the base array of transceivers for that location;

identifying a location, of the plurality of locations, with the highest combined correlation score; and

indicating that the event location is the location with the highest combined correlation score.

11. The method of claim 10 wherein the environment includes at least a section that is indoors.

12. The method of claim 10 wherein multiple pilot signals are transmitted from each location and each of the multiple pilot signals has a different frequency.

13. The method of claim 10 further comprising transmitting a notification that the event has occurred in the vicinity of the location with the highest combined correlation score.

14. The method of claim 10 further comprising directing the taking of a countermeasure based on the location with the highest combined correlation score.

15. The method of claim 10 wherein the event is a gunshot.

16. A method performed by one or more computing devices for determining an event location of an event within an environment, the method comprising:

for each of a plurality of sounds in sequence with an initial sound being an event sound of the event,

receiving, via transceivers of a base array of transceivers, the sound that traveled on multiple paths through the environment from an originating location to the base array;

for each sound received by a transceiver of the base array of transceivers, generating a time-reversed sound of the sound received by that transceiver; and

transmitting the time-reversed sounds via the transceivers of the base array of transceivers,

wherein a locator device located physically apart from the base array of transceivers at a locator location within the environment receives, via a receiver, the transmitted time-reversed sound and transmits, via a transmitter, the received time-reversed sound until the locator device determines that a received time-reversed sound is sufficiently focused to indicate that the event location is near the locator location.

17. The method of claim 16 wherein the received sound has portions that are ordered from a first portion received to a last portion received and the generating of the time-reversed sound orders the portions so that the last portion received is the first portion of the time-reversed sound and the first portion received is the last portion of the time-reversed sound.

18. The method of claim 16 wherein the environment is at least partially indoors.

19. The method of claim 16 wherein the generating and transmitting are in response to determining that an event has been detected.

20. The method of claim 16 further comprising encoding localization information into the time-reversed sound prior to transmitting the time-reversed sound.

21. The method of claim 16 wherein the event is a gunshot.

22. The method of claim 16 wherein when the location device determines that a received time-reversed sound is sufficiently focused, the location device directs taking a countermeasure.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2020
From: CANDY, JIM; FISHER, KARL A.; CANDY, CHRISTOPHER ROLAND
To: LAWRENCE LIVERMORE NATIONAL SECURITY, LLC
Reel/Frame 053645/0255 →
CONFIRMATORY LICENSE (SEE DOCUMENT FOR DETAILS) Recorded Aug 3, 2020
From: LAWRENCE LIVERMORE NATIONAL SECURITY, LLC
To: U.S. DEPARTMENT OF ENERGY
Reel/Frame 053386/0179 →
Continuity (1)
Related Publication 20220036913A1 · Feb 3, 2022