IP Library Granted Patent US 10,339,388
Granted Patent B1
US 10,339,388 · App. 15/606,667 · Granted Jul 2, 2019

Virtual sensors

Inventor: Stephen Scott Trundle (Falls Church, VA)
Assignee: Alarm.com Incorporated
G06K9/00771H04N7/18G06K2009/00738
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,339,388
App. No.
15/606,667
Granted
Jul 2, 2019
Kind
B1
Abstract

Virtual sensor technology, in which a camera is controlled to capture at least one configuration image of an area monitored by a monitoring system and input is received that defines one or more characteristics of the at least one configuration image that enable sensing of an event in the area. Based on the received input, configuration data used in sensing the event is generated and stored. After storage of the configuration data, the camera is controlled to capture one or more images of the area, the one or more images are analyzed based on the configuration data, and occurrence of the event is detected based on the analysis of the one or more images. Based on detecting occurrence of the event, a transmitting device is controlled to send, to a controller of the monitoring system, a signal that indicates the detection of the occurrence of the event.

Claims (78)

1. An electronic sensor comprising:

a camera configured to capture images of an area monitored by a monitoring system;

an electronic storage device configured to store data;

a transmitting device configured to send signals to a controller of the monitoring system; and

a processing device configured to perform operations comprising:

defining configuration data used in sensing an event through image data captured by a camera included in a monitoring system;

monitoring images captured by the camera for an error condition that reduces an ability to detect the event through image data captured by the camera;

based on the monitoring of images captured by the camera, detecting a potential error condition that reduces an ability to detect the event through image data captured by the camera;

determining a degree of severity of the potential error condition; and

handling the potential error condition based on the degree of severity,

wherein determining the degree of severity of the potential error condition comprises:

classifying the potential error condition as severe based on a determination that an entire field of view of the camera or an entire area of interest that is essential for detecting the event has been obstructed;

classifying the potential error condition as moderate based on a determination that a subset of anchor points have been obstructed and an area of interest has been partially obstructed; and

classifying the potential error condition as low based on a determination that a subset of anchor points have been obstructed, but an area of interest remains unobstructed.

2. The electronic sensor of claim 1 , wherein detecting the potential error condition that reduces the ability to detect the event through image data captured by the camera comprises detecting whether or not the camera has been moved by determining whether features representative of predefined anchor points are located correctly within image data of at least one of the monitored images.

3. The electronic sensor of claim 1 , wherein detecting the potential error condition that reduces the ability to detect the event through image data captured by the camera comprises detecting whether or not the camera has been moved by comparing image data of at least one of the monitored images to a preset background image and determining whether a background of images captured by the camera has changed.

4. A monitoring system comprising:

a controller configured to control monitoring operations for a property monitored by the monitoring system; and

an electronic sensor comprising:

a camera configured to capture images of an area monitored by a monitoring system; and

a processing device configured to perform operations comprising:

defining configuration data used in sensing an event through image data captured by a camera included in a monitoring system;

monitoring images captured by the camera for an error condition that reduces an ability to detect the event through image data captured by the camera;

based on the monitoring of images captured by the camera, detecting a potential error condition that reduces an ability to detect the event through image data captured by the camera;

determining a degree of severity of the potential error condition; and

handling the potential error condition based on the degree of severity,

wherein determining the degree of severity of the potential error condition comprises:

classifying the potential error condition as severe based on a determination that an entire field of view of the camera or an entire area of interest that is essential for detecting the event has been obstructed;

classifying the potential error condition as moderate based on a determination that a subset of anchor points have been obstructed and an area of interest has been partially obstructed; and

classifying the potential error condition as low based on a determination that a subset of anchor points have been obstructed, but an area of interest remains unobstructed.

5. The monitoring system of claim 4 , wherein monitoring images captured by the camera for the error condition comprises evaluating, each time an image is captured for detection of the event, the image to determine whether the error condition exists.

6. The monitoring system of claim 4 , wherein monitoring images captured by the camera for the error condition comprises periodically monitoring for an error condition outside of capturing an image for purposes of detecting the event.

7. The monitoring system of claim 4 , wherein detecting the potential error condition that reduces the ability to detect the event through image data captured by the camera comprises detecting whether or not the camera has been moved by determining whether features representative of predefined anchor points are located correctly within image data of at least one of the monitored images.

8. The monitoring system of claim 4 , wherein detecting the potential error condition that reduces the ability to detect the event through image data captured by the camera comprises detecting whether or not the camera has been moved by comparing image data of at least one of the monitored images to a preset background image and determining whether a background of images captured by the camera has changed.

9. The monitoring system of claim 4 , wherein handling the potential error condition based on the degree of severity comprises:

comparing the degree of severity with rules defining which action to take based on the degree of severity; and

determining which action to take based on the comparison.

10. A monitoring system comprising:

a controller configured to control monitoring operations for a property monitored by the monitoring system; and

an electronic sensor comprising:

a camera configured to capture images of an area monitored by a monitoring system; and

a processing device configured to perform operations comprising:

defining configuration data used in sensing an event through image data captured by a camera included in a monitoring system;

monitoring images captured by the camera for an error condition that reduces an ability to detect the event through image data captured by the camera;

based on the monitoring of images captured by the camera, detecting a potential error condition that reduces an ability to detect the event through image data captured by the camera;

determining a degree of severity of the potential error condition; and

handling the potential error condition based on the degree of severity,

wherein determining the degree of severity of the potential error condition comprises:

classifying the potential error condition as severe based on a determination that all anchor points have moved in a uniform manner and that an area of interest relative to the anchor points is outside of a field of view of the camera;

classifying the potential error condition as moderate based on a determination that all anchor points have moved in a uniform manner and that an area of interest relative to the anchor points is partially outside of the field of view of the camera; and

classifying the potential error condition as low based on a determination that all anchor points have moved in a uniform manner and that an area of interest relative to the anchor points is still within the field of view of the camera.

11. A method comprising:

defining configuration data used in sensing an event through image data captured by a camera included in a monitoring system;

monitoring images captured by the camera for an error condition that reduces an ability to detect the event through image data captured by the camera;

based on the monitoring of images captured by the camera, detecting a potential error condition that reduces an ability to detect the event through image data captured by the camera;

determining a degree of severity of the potential error condition; and

handling the potential error condition based on the degree of severity,

wherein determining the degree of severity of the potential error condition comprises:

classifying the potential error condition as severe based on a determination that an entire field of view of the camera or an entire area of interest that is essential for detecting the event has been obstructed;

classifying the potential error condition as moderate based on a determination that a subset of anchor points have been obstructed and an area of interest has been partially obstructed; and

classifying the potential error condition as low based on a determination that a subset of anchor points have been obstructed, but an area of interest remains unobstructed.

12. The method of claim 11 , wherein monitoring images captured by the camera for the error condition comprises evaluating, each time an image is captured for detection of the event, the image to determine whether the error condition exists.

13. The method of claim 11 , wherein monitoring images captured by the camera for the error condition comprises periodically monitoring for an error condition outside of capturing an image for purposes of detecting the event.

14. The method of claim 11 , wherein detecting the potential error condition that reduces the ability to detect the event through image data captured by the camera comprises detecting whether or not the camera has been moved by determining whether features representative of predefined anchor points are located correctly within image data of at least one of the monitored images.

15. The method of claim 11 , wherein detecting the potential error condition that reduces the ability to detect the event through image data captured by the camera comprises detecting whether or not the camera has been moved by comparing image data of at least one of the monitored images to a preset background image and determining whether a background of images captured by the camera has changed.

16. The method of claim 11 , wherein handling the potential error condition based on the degree of severity comprises:

comparing the degree of severity with rules defining which action to take based on the degree of severity; and

determining which action to take based on the comparison.

17. A method comprising:

defining configuration data used in sensing an event through image data captured by a camera included in a monitoring system;

monitoring images captured by the camera for an error condition that reduces an ability to detect the event through image data captured by the camera;

based on the monitoring of images captured by the camera, detecting a potential error condition that reduces an ability to detect the event through image data captured by the camera;

determining a degree of severity of the potential error condition; and

handling the potential error condition based on the degree of severity,

wherein determining the degree of severity of the potential error condition comprises:

classifying the potential error condition as severe based on a determination that all anchor points have moved in a uniform manner and that an area of interest relative to the anchor points is outside of a field of view of the camera;

classifying the potential error condition as moderate based on a determination that all anchor points have moved in a uniform manner and that an area of interest relative to the anchor points is partially outside of the field of view of the camera; and

classifying the potential error condition as low based on a determination that all anchor points have moved in a uniform manner and that an area of interest relative to the anchor points is still within the field of view of the camera.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Jan 21, 2021
From: SILICON VALLEY BANK
To: ENERGYHUB, INC.; ICN ACQUISITION, LLC; ALARM.COM INCORPORATED
Reel/Frame 055069/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2018
From: TRUNDLE, STEPHEN SCOTT
To: ALARM.COM INCORPORATED
Reel/Frame 044732/0022 →
SECURITY INTEREST Recorded Oct 10, 2017
From: ALARM.COM, INCORPORATED; ENERGYHUB, INC.; ICN ACQUISITION, LLC
To: SILICON VALLEY BANK
Reel/Frame 044167/0235 →
Continuity (3)
Continuation 14745856 · Jun 22, 2015
Continuation 13529629 · Jun 21, 2012
Provisional Application 61499917 · Jun 22, 2011
Cited By (1)
US 12,608,895