IP Library Granted Patent US 10,579,879
Granted Patent B2
US 10,579,879 · App. 15/233,035 · Granted Mar 3, 2020

Sonic sensing

Inventors: Jason C. Flint (Highland, UT); Christopher Lee Harris (Holladay, UT); Craig Matsuura (Draper, UT)
Assignee: Vivint, Inc.
G06K9/00771G10L25/51H04N5/232H04N5/23206H04N5/247H04R1/326H04R2430/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,579,879
App. No.
15/233,035
Granted
Mar 3, 2020
Kind
B2
Abstract

A method for security and/or automation systems is described. In one embodiment, the method may include receiving image data associated with an area via an image sensor, receiving sound data associated with an object via an audio sensor, analyzing the image data in relation to the sound data, detecting an object's presence based at least in part on the analyzing, and identifying at least one characteristic relating to the object based at least in part on the detecting.

Claims (66)

1. A method for security and/or automation systems, comprising:

receiving sound data associated with an object via an audio sensor located at a premises;

analyzing the sound data;

estimating a distance from the audio sensor to a detected sound based at least in part on the analysis of the sound data;

adjusting a field of view and a focus of an image sensor based at least in part on the estimated distance;

receiving image data associated with an area of the premises via the image sensor located at the premises based at least in part on adjusting the field of view and the focus;

analyzing the image data in relation to the analysis of the sound data;

detecting a presence of the object within the area based at least in part on the analysis of the image data;

detecting an indication of wind based at least in part on detecting the presence of the object;

identifying a false positive associated with the presence of the object within the area based at least in part on analyzing the image data and analyzing the sound data; and

determining whether to generate a notification based at least in part on the detected sound, the identified false positive, the presence of the object within the area, and the indication of wind.

2. The method of claim 1 , comprising:

determining whether the estimated distance satisfies a distance threshold.

3. The method of claim 1 , wherein the detected sound includes a footstep, a voice, a horn of a vehicle, an engine of a vehicle, a knocking on a door, a ringing of a doorbell, an opening of a door, a rustling of clothing, a gunshot, a glass breaking, a rattling of keys, or a combination thereof.

4. The method of claim 1 , wherein estimating the distance from the audio sensor to the detected sound is based at least in part on identifying a type of detected sound.

5. The method of claim 1 , comprising:

estimating a size of a source of the detected sound relative to the field of view of the image sensor based at least in part on at least one of the estimated distance and a type of detected sound.

6. The method of claim 2 , comprising:

initiating an adjustment of at least one characteristic of an automation component based at least in part on determining whether the estimated distance satisfies the distance threshold, wherein the automation component includes at least one of a motion sensor, the image sensor, a lock, a light, and the audio sensor.

7. The method of claim 1 , wherein the audio sensor comprises an active audio sensor.

8. The method of claim 1 , comprising:

capturing image data of the area after adjusting the field of view of the image sensor.

9. The method of claim 2 , comprising:

estimating a location of the detected sound.

10. The method of claim 9 , comprising:

tracking a source of the detected sound based at least in part on a subsequent detected sound.

11. An apparatus for an automation system, comprising:

a processor;

memory in electronic communication with the processor; and

instructions stored in the memory, the instructions being executable by the processor to:

receive sound data associated with an object via an audio sensor located at a premises;

analyze the sound data;

estimate a distance from the audio sensor to a detected sound based at least in part on the analysis of the sound data;

adjust a field of view and a focus of an image sensor based at least in part on the estimated distance;

receive image data associated with an area of the premises via the image sensor located at the premises based at least in part on adjusting the field of view and the focus;

analyze the image data in relation to the analysis of the sound data;

detect a presence of the object based at least in part on the analysis of the image data;

detect an indication of wind based at least in part on detecting the presence of the object;

identify a false positive associated with the presence of the object within the area based at least in part on analyzing the image data and analyzing the sound data; and

determine whether to generate a notification based at least in part on the detected sound, the identified false positive, the presence of the object within the area, and the indication of wind.

12. The apparatus of claim 11 , the instructions being executable by the processor to:

determine whether the estimated distance satisfies a distance threshold.

13. The apparatus of claim 11 , wherein the detected sound includes a footstep, a voice, a horn of a vehicle, an engine of a vehicle, a knocking on a door, a ringing of a doorbell, an opening of a door, a rustling of clothing, a gunshot, a glass breaking, a rattling of keys, or a combination thereof.

14. The apparatus of claim 11 , wherein estimating the distance from the audio sensor to the detected sound is based at least in part on identifying a type of detected sound.

15. The apparatus of claim 12 , the instructions being executable by the processor to:

initiate an adjustment of at least one characteristic of an automation component based at least in part on determining whether the estimated distance satisfies the distance threshold, wherein the automation component includes at least one of a motion sensor, the image sensor, a lock, a light, and the audio sensor.

16. The apparatus of claim 12 , the instructions being executable by the processor to:

capture image data of the area after adjusting the field of view of the image sensor.

17. A non-transitory computer-readable medium storing computer-executable code for an automation system, the code executable by a processor to:

receive sound data associated with an object via an audio sensor located at a premises;

analyze the sound data;

estimate a distance from the audio sensor to a detected sound based at least in part on the analysis of the sound data;

adjust a field of view and a focus of an image sensor based at least in part on the estimated distance;

receive image data associated with an area via the image sensor located at the premises based at least in part on adjusting the field of view and the focus;

analyze the image data in relation to the analysis of the sound data;

detect a presence of the object within the area based at least in part on the analysis of the image data;

detect an indication of wind based at least in part on detecting the presence of the object;

identify a false positive associated with the presence of the object within the area based at least in part on analyzing the image data and analyzing the sound data; and

determine whether to generate a notification based at least in part on the detected sound, the identified false positive, the presence of the object within the area, and the indication of wind.

18. The method of claim 2 , comprising:

emitting, by the audio sensor, an ultrasonic sound ping towards the object; and

receiving, at the audio sensor, an echo of the ultrasonic sound ping, wherein estimating the distance from the audio sensor to the detected sound is based at least in part on the received echo.

19. The method of claim 1 , comprising:

determining that the object is associated with the indication of a wind based at least in part on the analysis of the sound data and the analysis of the image data, wherein determining whether to generate the notification comprises determining not to generate the notification based on the object being associated with the indication of the wind.

20. The method of claim 1 , comprising:

initiating an adjustment of a focus window of the image sensor.

Assignments (8)
AFTER-ACQUIRED INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Feb 27, 2025
From: VIVINT LLC; SMART HOME PROS, INC.; VIVINT AMIGO, INC.
To: DEUTSCHE BANK TRUST COMPANY AMERICAS, AS PRIORITY COLLATERAL TRUSTEE
Reel/Frame 070349/0816 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT REEL 049283, FRAME 0566 Recorded Nov 11, 2024
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: VIVINT, INC.
Reel/Frame 069334/0137 →
RELEASE (REEL 047029/ FRAME 0304) Recorded Nov 1, 2024
From: BANK OF AMERICA, N.A.
To: VIVINT LLC (F/K/A VIVINT, INC.)
Reel/Frame 069289/0468 →
RELEASE OF SECURITY INTEREST Recorded Jul 12, 2021
From: BANK OF AMERICA, N.A.
To: VIVINT, INC.
Reel/Frame 056832/0824 →
SECURITY AGREEMENT Recorded May 23, 2019
From: VIVINT, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 049283/0566 →
SUPPL. NO. 2 SECURITY AGREEMENT Recorded Sep 6, 2018
From: VIVINT, INC.
To: BANK OF AMERICA N.A.
Reel/Frame 047024/0048 →
SECURITY AGREEMENT Recorded Sep 6, 2018
From: VIVINT, INC.
To: BANK OF AMERICA, N.A.
Reel/Frame 047029/0304 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2016
From: FLINT, JASON C.; HARRIS, CHRISTOPHER LEE; MATSUURA, CRAIG
To: VIVINT, INC.
Reel/Frame 039393/0397 →
Continuity (1)
Related Publication 20180046864A1 · Feb 15, 2018