IP Library › Granted Patent US 12,608,895
Granted Patent B2
US 12,608,895 · App. 18/631,809 · Granted Apr 21, 2026

Enhancing monitoring system with augmented reality

Inventor: Donald Madden (Columbia, MD)
Assignee: ObjectVideo Labs, LLC
G06T19/006G06V20/20G06V20/52G06T2219/004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,608,895
App. No.
18/631,809
Filed
Apr 10, 2024
Granted
Apr 21, 2026
Kind
B2
Art Unit
2614
USPC
345/633
Abstract

A computer-implemented method includes obtaining an image of an area of a property from an augmented reality device, identifying the area of the property based on the image obtained from the augmented reality device, determining that the area of the property corresponds to an event at the property or a configuration of a monitoring system of the property, and providing, in response to determining that the area of the property corresponds to the event or the configuration, information that represents the event or the configuration and that is configured to be displayed on the augmented reality device.

Claims (56)

1 . A method comprising:

maintaining, in a memory of an extended reality device, at least a portion of a three-dimensional model a) of a property and b) that includes a model of each of a plurality of components including a sensor of a monitoring system physically located at the property;

providing, on a display of the extended reality device and using the portion of the three-dimensional model of the property, a first representation representing a first portion of the property and the sensor;

receiving, by the extended reality device while the extended reality device displays the first representation using the three-dimensional model of the property and an input device of the extended reality device, an input that indicates a modification of a configuration of the sensor that is physically located within the first portion of the property and that is visualized in the first representation;

in response to receiving the input, transmitting, by the extended reality device and to the monitoring system, an instruction to update the configuration of the sensor of the monitoring system physically located at the property using data representing the input; and

providing, on the display of the extended reality device, a second representation of the portion of the three-dimensional model of the property and the sensor using the three-dimensional model of the property that includes the model of the sensor that is physically located within the first portion of the property and a visualization of the updated configuration of the sensor of the monitoring system that represents the modification of the configuration of the sensor.

2 . The method of claim 1 , wherein transmitting an instruction to update the configuration of the sensor of the monitoring system physically located at the property using the data representing the input comprises:

transmitting data that indicates a modification to a configuration of at least one of a monitoring zone or virtual tripwire.

3 . The method of claim 1 , wherein transmitting an instruction to update the configuration of the sensor of the monitoring system physically located at the property using the data representing the input comprises:

transmitting data that indicates a modification to a configuration of a camera installed at the property and wherein the modification comprises a modification of at least one of orientation, frame rate, or focal length of the camera.

4 . The method of claim 1 , wherein transmitting an instruction to update the configuration of the sensor of the monitoring system physically located at the property using the data representing the input comprises:

transmitting data that represents the input received using the input device of the extended reality device.

5 . The method of claim 1 , wherein providing, on a display of the extended reality device, the first representation representing the first portion of the property and the sensor comprises:

providing a visualization of a set of predefined monitoring system configurations.

6 . The method of claim 5 , wherein receiving the input that indicates the modification of the configuration of the sensor that is physically located within the first portion of the property and that is visualized in the first representation comprises:

receiving data that indicates a predefined monitoring system configuration selected from among the set of predefined monitoring system configurations in the first representation representing the first portion of the property and the sensor, each predefined monitoring system configuration of the set of predefined monitoring system configurations having a different representation in the first representation.

7 . The method of claim 1 , wherein receiving, by the extended reality device while the extended reality device displays the first representation using the three-dimensional model of the property and the input device of the extended reality device, the input that indicates the modification of the configuration of the sensor comprises at least one of:

receiving motion input from a motion sensor of the input device;

receiving touch input from a touch sensor of the input device; or

receiving voice input from an audio sensor of the input device.

8 . The method of claim 1 , wherein providing, on the display of the extended reality device, the first representation representing the first portion of the property and the sensor comprises:

displaying a visualization that includes one or more visualizations of monitoring zones at the property.

9 . The method of claim 1 , wherein providing, on a display of the extended reality device, the first representation representing the first portion of the property and the sensor comprises:

displaying a visualization that includes one or more visualizations of virtual tripwires at the property.

10 . The method of claim 1 , wherein providing, on a display of the extended reality device, the first representation representing the first portion of the property and the sensor comprises:

displaying a visualization that includes one or more visualizations of one or more cameras installed at the property.

11 . A system comprising one or more computers and one or more storage devices on which are stored instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

maintaining, in a memory of an extended reality device, at least a portion of a three-dimensional model a) of a property and b) that includes a model of each of a plurality of components including a sensor of a monitoring system physically located at the property;

providing, on a display of the extended reality device and using the portion of the three-dimensional model of the property, a first representation representing a first portion of the property and the sensor;

receiving, by the extended reality device while the extended reality device displays the first representation using the three-dimensional model of the property and an input device of the extended reality device, an input that indicates a modification of a configuration of the sensor that is physically located within the first portion of the property and that is visualized in the first representation;

in response to receiving the input, transmitting, by the extended reality device and to the monitoring system, an instruction to update the configuration of the sensor of the monitoring system physically located at the property using data representing the input; and

providing, on the display of the extended reality device, a second representation of the portion of the three-dimensional model of the property and the sensor using the three-dimensional model of the property that includes the model of the sensor that is physically located within the first portion of the property and a visualization of the updated configuration of the sensor of the monitoring system that represents the modification of the configuration of the sensor.

12 . The system of claim 11 , wherein transmitting an instruction to update the configuration of the sensor of the monitoring system physically located at the property using the data representing the input comprises:

transmitting data that indicates a modification to a configuration of at least one of a monitoring zone or virtual tripwire.

13 . The system of claim 11 , wherein transmitting an instruction to update the configuration of the sensor of the monitoring system physically located at the property using the data representing the input comprises:

transmitting data that indicates a modification to a configuration of a camera installed at the property and wherein the modification comprises a modification of at least one of orientation, frame rate, or focal length of the camera.

14 . The system of claim 11 , wherein transmitting an instruction to update the configuration of the sensor of the monitoring system physically located at the property using the data representing the input comprises:

transmitting data that represents the input received using the input device of the extended reality device.

15 . The system of claim 11 , wherein providing, on a display of the extended reality device, the first representation representing the first portion of the property and the sensor comprises:

providing a visualization of a set of predefined monitoring system configurations.

16 . The system of claim 15 , wherein receiving the input that indicates the modification of the configuration that is physically located within the first portion of the property and that is visualized in the first representation comprises:

receiving data that indicates a predefined monitoring system configuration selected from among the set of predefined monitoring system configurations in the first representation representing the first portion of the property and the sensor, each predefined monitoring system configuration of the set of predefined monitoring system configurations having a different representation in the first representation.

17 . The system of claim 11 , wherein receiving, by the extended reality device while the extended reality device displays the first representation using the three-dimensional model of the property and the input device of the extended reality device, the input that indicates the modification of the configuration of the sensor comprises at least one of:

receiving motion input from a motion sensor of the input device;

receiving touch input from a touch sensor of the input device; or

receiving voice input from an audio sensor of the input device.

18 . The system of claim 11 , wherein providing, on the display of the extended reality device, the first representation representing the first portion of the property and the sensor comprises:

displaying a visualization that includes one or more visualizations of monitoring zones at the property.

19 . The system of claim 11 , wherein providing, on a display of the extended reality device, the first representation representing the first portion of the property and the sensor comprises:

displaying a visualization that includes one or more visualizations of one or more cameras installed at the property.

20 . One or more computer storage media encoded with instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:

maintaining, in a memory of an extended reality device, at least a portion of a three-dimensional model a) of a property and b) that includes a model of each of a plurality of components including a sensor of a monitoring system physically located at the property;

providing, on a display of the extended reality device and using the portion of the three-dimensional model of the property, a first representation representing a first portion of the property and the sensor;

receiving, by the extended reality device while the extended reality device displays the first representation using the three-dimensional model of the property and an input device of the extended reality device, an input that indicates a modification of a configuration of the sensor that is physically located within the first portion of the property and that is visualized in the first representation;

in response to receiving the input, transmitting, by the extended reality device and to the monitoring system, an instruction to update the configuration of the sensor of the monitoring system physically located at the property using data representing the input; and

providing, on the display of the extended reality device, a second representation of the portion of the three-dimensional model of the property and the sensor using the three-dimensional model of the property that includes the model of the sensor that is physically located within the first portion of the property and a visualization of the updated configuration of the sensor of the monitoring system that represents the modification of the configuration of the sensor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2024
From: MADDEN, DONALD
To: OBJECTVIDEO LABS, LLC
Reel/Frame 067154/0595 →
Continuity (5)
Continuation 17496041 · Oct 7, 2021
Continuation 17019861 · Sep 14, 2020
Continuation 16057890 · Aug 8, 2018
Provisional Application 62544084 · Aug 11, 2017
Related Publication 20240257483A1 · Aug 1, 2024
References Cited (36)
US 6970183B1 · Monroe · 2005 [cited by applicant]
US 9064394B1 · Trundle · 2015 [cited by applicant]
US 9665778B1 · Trundle · 2017 [cited by applicant]
US 10339388B1 · Trundle · 2019 [cited by applicant]
US 10803667B1 · Madden · 2020 [cited by applicant]
US 10841537B2 · Valli et al. · 2020 [cited by applicant]
US 10915758B1 · Trundle · 2021 [cited by applicant]
US 11164389B2 · Madden · 2021 [cited by applicant]
US 11354908B2 · Trundle · 2022 [cited by applicant]
US 20050111696A1 · Baer · 2005 [cited by applicant]
US 20070024707A1 · Brodsky · 2007 [cited by applicant]
US 20070262857A1 · Jackson · 2007 [cited by applicant]
US 20080136910A1 · Berkey et al. · 2008 [cited by applicant]
US 20090244070A1 · Mattikalli et al. · 2009 [cited by applicant]
US 20090249387A1 · Magdy et al. · 2009 [cited by applicant]
US 20110043689A1 · Cobb et al. · 2011 [cited by applicant]
US 20110188760A1 · Wright et al. · 2011 [cited by applicant]
US 20120113145A1 · Adhikari et al. · 2012 [cited by applicant]
US 20140247283A1 · Jo · 2014 [cited by applicant]
US 20150187138A1 · Mullins · 2015 [cited by examiner]
US 20160180468A1 · Buss et al. · 2016 [cited by applicant]
US 20160210790A1 · Rasane · 2016 [cited by examiner]
US 20170049007A1 · Wei et al. · 2017 [cited by applicant]
US 20170270362A1 · Barnehama et al. · 2017 [cited by applicant]
US 20170334559A1 · Bouffard et al. · 2017 [cited by applicant]
US 20180129276A1 · Nguyen et al. · 2018 [cited by applicant]
US 20180143756A1 · Mildrew · 2018 [cited by examiner]
US 20180150698A1 · Guttnnann et al. · 2018 [cited by applicant]
US 20180190017A1 · Mendez et al. · 2018 [cited by applicant]
US 20180276872A1 · Case · 2018 [cited by examiner]
US 20190051051A1 · Kaufman et al. · 2019 [cited by applicant]
US 20200410771A1 · Madden · 2020 [cited by applicant]
US 20210158054A1 · Trundle · 2021 [cited by applicant]
US 20220028176A1 · Madden · 2022 [cited by applicant]
US 20220284708A1 · Trundle · 2022 [cited by applicant]
CN 204272295 · 2015 [cited by applicant]