IP Library › Granted Patent US 10,914,811
Granted Patent B1
US 10,914,811 · App. 16/137,166 · Granted Feb 9, 2021

Locating a source of a sound using microphones and radio frequency communication

Inventor: Benjamin Wild (Marina Del Rey, CA)
Assignee: Amazon Technologies, Inc.
G01S3/8083G08B3/1016H04M11/025H04R29/004H04S2400/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,914,811
App. No.
16/137,166
Granted
Feb 9, 2021
Kind
B1
Abstract

A source of a sound is located by two or more computing devices (e.g., A/V recording and communication devices) using microphones and radio frequency communication among the computing devices. The location of the source is determined based on at least a time difference between a time that a notification from a first computing device regarding the sound arrives at a second computing device, and a time of detecting the sound at the second computing device. Additional data may be collected and/or other actions may be taken in response to locating the source of the sound.

Claims (65)

1. A method for locating a source of a sound, the method comprising:

detecting, at a first A/V recording and communication device, the sound;

transmitting, by the first A/V recording and communication device, a first notification in response to detecting the sound;

receiving, at a second A/V recording and communication device, the first notification from the first A/V recording and communication device;

detecting, at the second A/V recording and communication device, the sound;

determining, at the second A/V recording and communication device, based on at least a time of arrival of the first notification at the second A/V recording and communication device and a time of arrival of the sound at the second A/V recording and communication device, a time difference between the time of arrival of the first notification at the second A/V recording and communication device and the time of arrival of the sound at the second A/V recording and communication device;

transmitting, by the second A/V recording and communication device, a second notification including the time difference between the time of arrival of the first notification at the second A/V recording and communication device and the time of arrival of the sound at the second A/V recording and communication device;

receiving, at a network device, the second notification; and

determining a location of the source of the sound based on at least a location of the first A/V recording and communication device, a location of the second A/V recording and communication device, and the time difference between the time of arrival of the first notification at the second A/V recording and communication device and the time of arrival of the sound at the second A/V recording and communication device.

2. The method of claim 1 , wherein the first A/V recording and communication device comprises a radio, the first notification is transmitted by the radio to the second A/V recording and communication device, and the second A/V recording and communication device detects the sound after receiving the first notification.

3. The method of claim 1 , further comprising, after determining the location of the source of the sound:

identifying, based on the location of the source of the sound, at least one camera device; and

causing the identified at least one camera device to record and transmit at least one of audio data or image data to a computing device.

4. The method of claim 1 , further comprising, in response to determining the location of the source of the sound, causing the location of the source of the sound to be transmitted to a client device associated with at least the first A/V recording and communication device or the second A/V recording and communication device.

5. The method of claim 1 , wherein the sound is a first sound, the method further comprising:

prior to detecting the first sound, causing the source of the sound to generate a second sound;

detecting the second sound; and

generating, based on the detected second sound, a signature corresponding to the second sound;

wherein determining the location of the source of the sound is further based on the signature.

6. The method of claim 1 , further comprising, prior to detecting the sound at the first A/V recording and communication device, receiving location data from a client device associated with the first A/V recording and communication device, wherein the client device is configured to transmit the location data when physically proximate to the source of the sound, and wherein determining the location of the source of the sound is further based on the location data.

7. The method of claim 1 , further comprising:

determining a first location in the interior of a structure, on the exterior of a structure, or at a geographic location outside of a structure; and

storing the first location in at least one database;

wherein the determined location of the source of the sound corresponds to the first location.

8. The method of claim 1 , wherein:

the sound is detected by a microphone of the first A/V recording and communication device; and

the microphone detects the sound after the microphone has transitioned from a passive state to an active state in response to a determination that an amplitude of a prior sound detected by the microphone exceeds a predetermined threshold.

9. A system for locating a source of a sound, the system comprising:

a first A/V recording and communication device configured to transmit a first notification in response to detecting the sound;

a second A/V recording and communication device configured to:

receive the first notification from the first A/V recording and communication device;

detect the sound;

determine, based on at least a time of arrival of the first notification at the second A/V recording and communication device and a time of arrival of the sound at the second A/V recording and communication device, a time difference between the time of arrival of the first notification at the second A/V recording and communication device and the time of arrival of the sound at the second A/V recording and communication device;

transmit a second notification including the time difference between the time of arrival of the first notification at the second A/V recording and communication device and the time of arrival of the sound at the second A/V recording and communication device; and

a network device configured to receive the second notification and determine a location of the source of the sound based on at least the time difference between the time of arrival of the first notification at the second A/V recording and communication device and the time of arrival of the sound at the second A/V recording and communication device.

10. The system of claim 9 , wherein the first A/V recording and communication device comprises a radio configured to transmit the first notification to the second A/V recording and communication device, and the second A/V recording and communication device is further configured to detect the sound after receiving the first notification.

11. A method for locating a source of a sound, the method comprising:

receiving a first notification from a first computing device, wherein the first notification is transmitted by the first computing device in response to detecting the sound;

receiving a second notification from a second computing device that also received the first notification, wherein the second notification is transmitted by the second computing device in response to detecting the sound; and

determining a location of the source of the sound based on at least a time difference between a time of arrival of the first notification at the second computing device and a time of detecting the sound at the second computing device.

12. The method of claim 11 , wherein the time of arrival of the first notification at the second computing device and the time of detecting the sound at the second computing device are each determined based on a network time protocol.

13. The method of claim 11 , wherein the second notification includes the time difference.

14. The method of claim 11 , wherein the second notification includes the time of arrival of the first notification at the second computing device and the time of detecting the sound at the second computing device.

15. The method of claim 11 , wherein the first notification includes a time of detecting the sound at the first computing device.

16. The method of claim 11 , wherein determining the location of the source of the sound is further based on a location of the first computing device and a location of the second computing device.

17. The method of claim 11 , wherein the second computing device is configured to determine the time difference.

18. The method of claim 11 , wherein the first computing device comprises a radio, and the first notification is transmitted by the radio to the second computing device.

19. The method of claim 11 , further comprising:

receiving a third notification from a third computing device that also received the first notification, the third notification including a time difference between a time of arrival of the first notification at the third computing device and a time of detecting the sound at the third computing device;

wherein determining the location of the source of the sound is further based on at least a location of the third computing device and the time difference between the time of arrival of the first notification at the third computing device and the time of detecting the sound at the third computing device.

20. The method of claim 11 , further comprising, after determining the location of the source of the sound, causing at least one camera device to record and transmit at least one of audio data or image data.

21. The method of claim 11 , further comprising, in response to determining the location of the source of the sound, causing the location of the source of the sound to be transmitted to a client device associated with the second computing device.

22. The method of claim 11 , further comprising, in response to determining the location of the source of the sound, causing the location of the source of the sound to be transmitted to a third computing device.

23. The method of claim 11 , wherein the sound is a first sound, the method further comprising:

causing the source of the sound to generate a second sound; and

generating a signature corresponding to the second sound;

wherein determining the location of the source of the sound is further based on the signature.

24. The method of claim 11 , wherein:

determining the location of the source of the sound is further based on location data received from a client device prior to detecting the sound at the second computing device; and

the client device is configured to transmit the location data when physically proximate to the source of the sound.

25. The method of claim 11 , further comprising:

determining a first location in the interior of a structure, on the exterior of a structure, or at a geographic location outside of a structure;

wherein the determined location of the source of the sound corresponds to the first location.

26. The method of claim 11 , wherein the sound is detected at the second computing device by a microphone after the second computing device transitions from a passive state to an active state.

27. The method of claim 11 , wherein at least one of the first computing device and the second computing device is an A/V recording and communication device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2018
From: WILD, BENJAMIN
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 046931/0377 →
Cited By (2)
US 12,249,327 US 12,625,218