IP Library Granted Patent US 11,741,820
Granted Patent B1
US 11,741,820 · App. 18/089,901 · Granted Aug 29, 2023

Aerial surveillance for premises security systems

Inventors: Edward M. Bacco (Lopez Island, WA); Philippe Sawaya (New York, NY); Scott William Schmidt (Newport, WA)
Assignee: The ADT Security Corporation
G08B25/001H04B7/18504
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,741,820
App. No.
18/089,901
Granted
Aug 29, 2023
Kind
B1
Abstract

A method implemented by a system for security comprising an unmanned aerial vehicle (UAV) and an analytics device configured to communicate with a remote monitoring system and the UAV is provided. Media data from the UAV is received at an analytics device, where the media data includes surveillance information corresponding to a premises under surveillance. Security attributes associated with the premises are detected based at least in part on a first level of machine learning (ML) analysis performed on the media data. The media data are transmitted by the analytics device to the remote monitoring system for a second level of ML analysis based at least in part on the security attribute, where the first level of ML analysis is less computationally expensive compared to the second level of ML analysis, and the second level of ML analysis is performed at the remote monitoring system on the media data.

Claims (80)

1. An analytics device for an unmanned aerial vehicle (UAV), the analytics device being configured to communicate with a remote monitoring system and the UAV, the analytics device comprising processing circuitry configured to:

receive media data from the UAV, the media data comprising surveillance information corresponding to a premises;

detect a security attribute associated with the premises based at least in part on a first level of machine learning (ML) analysis of the media data; and

cause transmission of at least a portion of the media data to the remote monitoring system for a second level of ML analysis based at least in part on the security attribute, the first level of ML analysis being less computationally expensive compared to the second level of ML analysis.

2. The analytics device of claim 1 , wherein the processing circuitry is further configured to:

determine an alarm probability level associated with the security attribute; and

transmit at least the portion of the media data to the remote monitoring system only when the alarm probability level exceeds a preconfigured threshold.

3. The analytics device of claim 1 , wherein processing circuitry is further configured to:

receive a security alert from the remote monitoring system indicating a premises area associated with the premises;

responsive to receiving the security alert, cause transmission of an indication to the UAV for the UAV to transit to the premises area; and

receive, responsive to the indication, the media data from the UAV, the media data including surveillance information associated with the premises area.

4. The analytics device of claim 1 , wherein the media data comprises at least one of:

a video surveillance feed recorded by the UAV; or

biometric sensor information recorded by the UAV.

5. The analytics device of claim 1 , wherein the processing circuitry is further configured to detect the security attribute of the media data by:

identifying a dominant object in an image frame of the media data;

determining a classification of the dominant object based on the first level of ML analysis; and

mapping the classification to the security attribute based on a preconfigured security attribute mapping.

6. The analytics device of claim 1 , wherein the security attribute comprises at least one of:

an alarm probability level;

a threat severity level indication;

a priority level indication;

a broken window indication;

an open door indication;

an intruder indication; or

an identification of a person in a premises area.

7. The analytics device of claim 1 , wherein the analytics device lacks a configuration for notifying first responders and the remote monitoring system has a configuration for notifying first responders based on the second level of ML analysis.

8. A system for security comprising:

an unmanned aerial vehicle (UAV);

an analytics device being configured to communicate with a remote monitoring system and the UAV, the analytics device comprising processing circuitry configured to:

receive media data from the UAV, the media data comprising surveillance information corresponding to a premises;

detect a security attribute associated with the premises based at least in part on a first level of machine learning (ML) analysis of the media data; and

cause transmission of at least a portion of the media data to the remote monitoring system for a second level of ML analysis based at least in part on the security attribute, the first level of ML analysis being less computationally expensive compared to the second level of ML analysis; and

the remote monitoring system comprising processing circuitry configured to:

receive at least the portion of the media data from the analytics device; and

responsive to receiving at least the portion of the media data, perform the second level of ML analysis on at least the portion of the media data.

9. The system of claim 8 , wherein the processing circuitry of the analytics device is further configured to:

determine an alarm probability level associated with the security attribute; and

cause transmission of at least the portion of the media data to the remote monitoring system only when the alarm probability level exceeds a preconfigured threshold.

10. The system of claim 8 , wherein the processing circuitry of the remote monitoring system is further configured to receive, from the analytics device, an indication of the security attribute; and

the second level of ML analysis comprises determining a prediction accuracy of the security attribute.

11. The system of claim 10 , wherein the processing circuitry of the remote monitoring system is further configured to:

cause transmission of an emergency alert to first responders only when the prediction accuracy exceeds a preconfigured threshold.

12. The system of claim 8 , wherein the second level of ML analysis comprises detecting an additional security attribute associated with the premises based at least in part on the media data; and

the processing circuitry of the remote monitoring system is further configured to cause transmission of an emergency alert to first responders based at least in part on the additional security attribute.

13. The system of claim 12 , wherein the processing circuitry of the remote monitoring system is further configured to detect the additional security attribute by:

identifying a dominant object in an image frame of the media data;

determining a classification of the dominant object; and

mapping the classification to the additional security attribute based on a preconfigured security attribute mapping.

14. The system of claim 8 , wherein the processing circuitry of the remote monitoring system is further configured to:

receive security information from at least one of a premises security system or a remote first responder service; and

cause transmission of a security alert to the analytics device based at least in part on the security information, the security alert indicating a premises area associated with the premises for monitoring; and

the processing circuitry of the analytics device is further configured to:

receive the security alert from the remote monitoring system indicating the premises area associated with the premises for monitoring;

responsive to receiving the security alert, cause transmission of an indication to the UAV for the UAV to transit to the premises area; and

receive, responsive to the indication, the media data from the UAV, the media data comprising surveillance information associated with the premises area.

15. The system of claim 8 , wherein the media data comprises at least one of:

a video surveillance feed recorded by the UAV; or

biometric sensor information recorded by the UAV.

16. The system of claim 8 , wherein the security attribute comprises at least one of:

an alarm probability level;

a threat severity level indication;

a priority level indication;

a broken window indication;

an open door indication;

an intruder indication; or

an identification of a person in a premises area.

17. A method implemented by a system for security comprising an unmanned aerial vehicle (UAV), an analytics device being configured to communicate with a remote monitoring system and the UAV, the method comprising:

receiving, at the analytics device, media data from the UAV, the media data comprising surveillance information corresponding to a premises;

detecting, at the analytics device, a security attribute associated with the premises based at least in part on a first level of machine learning (ML) analysis of the media data;

causing transmission, from the analytics device, of at least a portion of the media data to the remote monitoring system for a second level of ML analysis based at least in part on the security attribute, the first level of ML analysis being less computationally expensive compared to the second level of ML analysis;

receiving, at the remote monitoring system, at least the portion of the media data from the analytics device; and

responsive to receiving at least the portion of the media data, performing, at the remote monitoring system, the second level of ML analysis on at least the portion of the media data.

18. The method of claim 17 , wherein the method further comprises:

determining, at the analytics device, an alarm probability level associated with the security attribute; and

causing transmission, from the analytics device, of at least the portion of the media data to the remote monitoring system only when the alarm probability level exceeds a preconfigured threshold.

19. The method of claim 17 , wherein the method further comprises receiving, at the remote monitoring system, an indication of the security attribute; and

the second level of ML analysis comprises determining a prediction accuracy of the security attribute.

20. The method of claim 17 , wherein the second level of ML analysis comprises detecting, at the remote monitoring system, an additional security attribute associated with the premises based at least in part on the media data; and

the method further comprises causing transmission, from the remote monitoring system, of an emergency alert to first responders based at least in part on the additional security attribute.

Assignments (5)
PATENT SECURITY AGREEMENT Recorded Oct 3, 2023
From: ADT COMMERCIAL LLC
To: ALTER DOMUS (US) LLC
Reel/Frame 065114/0959 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 2, 2023
From: ADT LLC; THE ADT SECURITY CORPORATION
To: ADT COMMERCIAL LLC
Reel/Frame 065094/0621 →
PARTIAL RELEASE (REEL 063489 / FRAME 0434) Recorded Oct 2, 2023
From: BARCLAYS BANK PLC
To: THE ADT SECURITY CORPORATION
Reel/Frame 065101/0092 →
SECURITY INTEREST Recorded Apr 28, 2023
From: THE ADT SECURITY CORPORATION
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 063489/0434 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2023
From: BACCO, EDWARD M.; SAWAYA, PHILIPPE; SCHMIDT, SCOTT WILLIAM
To: THE ADT SECURITY CORPORATION
Reel/Frame 062908/0706 →
Cited By (6)
US 12,299,557 US 12,392,583 US 12,567,282 US 12,602,971 US 12,635,744 US 12,700,296