IP Library Granted Patent US 10,217,003
Granted Patent B2
US 10,217,003 · App. 15/369,619 · Granted Feb 26, 2019

Systems and methods for automated analytics for security surveillance in operation areas

Inventor: Martin A. Renkis (Nashville, TN)
Assignee: Sensormatic Electronics, LLC
G06K9/00771G08B13/196G08B13/19656H04N7/181H04L67/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,217,003
App. No.
15/369,619
Granted
Feb 26, 2019
Kind
B2
Abstract

Systems and methods for cloud-based surveillance for an operation area are disclosed. At least two input capture devices, at least one safety control device and at least one user device are communicatively connected to a cloud-based analytics platform. The cloud-based analytics platform automatically generates 3-Dimensional (3D) surveillance data based on received 2-Dimensional (2D) video and/or image inputs and perform advanced analytics and activates the at least one safety control device based on analytics data from advanced analytics.

Claims (50)

1. A cloud-based surveillance system for a target surveillance area comprising:

at least two input capture devices (ICDs), wherein each of the ICDs has at least one visual sensor for capturing input data from the surveillance area;

a cloud-based analytics platform,

wherein the cloud-based analytics platform is constructed and configured in network-based communication with the at least two ICDs;

wherein each of the at least two ICDs is operable to transmit the Input data to the cloud-based analytics platform; and

wherein the cloud-based analytics platform Is operable to:

generate a 3-Dimensional (3D) visual representation of the target surveillance area based on the captured input data from the at least two ICDs;

perform analytics based on the captured input data and generated 3D visual representation; and

determine at least one pattern of movement of one or more individuals within the surveillance area based on the performed analytics.

2. The system of claim 1 , wherein the cloud-based analytics platform provides data storage within a selectable period of time.

3. The system of claim 1 , further comprising at least one user device communicatively connected to the cloud-based platform, wherein the at least one user device comprises a display and a user interface, and wherein the at least one user device is operable to display the 3D visual representation of the target surveillance area.

4. A cloud-based system for monitoring a retail space, the cloud-based system comprising:

a plurality of input capture devices (ICDs), the plurality of ICDs including at least a first ICD and second ICD each having a camera for capturing images and/or video from the retail space; and

a cloud-based analytics platform in network-based communication with the ICDs, wherein the cloud-based analytics platform includes a memory and one or more processors, the memory storing instructions executable by the one or more processors to cause the cloud-based analytics platform to—

receive the images and/or video from the first ICD and the second ICD over a network;

generate a 3-Dimensional (3D) representation of one or more movements in the retail space based at least on

a first image and a second image, or

a first video received from the first ICD and a second video received from the second ICD;

perform 3D analytics based on the generated 3D representation and the images and/or video received from the first and second ICDs; and

generate a plurality of patterns of human movement within the retail space based on results from the 3D analytics.

5. The system of claim 4 , wherein the plurality of ICDs are configured for wireless cross-communication with one another independent of the cloud-based analytics platform, wherein the cross-communication includes exchange of ICD input data and ICD settings.

6. A cloud-based surveillance system for an environment comprising:

a cloud-based analytics platform in network-based communication with at least two Input capture devices (ICDs), wherein each of the at least two ICDs includes a visual sensor for capturing input data from the environment, wherein the at least two ICDs are configured to transmit the input data to the cloud-based analytics platform via a network, and wherein the cloud-based analytics platform includes a memory and at least one processor, the memory storing instructions executable by the at least one processor to—

generate a 3-Dimensional (3D) representation of movements in the environment based, at least in part, on the captured input data from the at least two ICDs,

perform analytics based, at least in part, on the captured input data and the generated 3D representation, and

generate a pattern of movement of one or more subjects within the environment based, at least in part, on results of the analytics.

7. The cloud-based surveillance system of claim 6 , wherein the pattern of movement is a pattern of human movement determined in real-time or near-real-time.

8. The cloud-based surveillance system of claim 6 , wherein the pattern of movement includes an activity density within the environment.

9. The cloud-based surveillance system of claim 8 , wherein the activity density is representative of the movement of multiple humans proximate to at least one of an advertisement or presentation of articles located in the environment.

10. The cloud-based surveillance system of claim 6 , wherein the pattern of movement includes a quantifier of one or more subjects in and/or passing through a portion of the environment.

11. The cloud-based surveillance system of claim 6 , wherein the pattern of movement includes a formation of a line, cluster, and/or grouping within the environment.

12. The cloud-based surveillance system of claim 6 , wherein the memory further contains instructions executable by the at least one processor to cause system to provide an indication, to a user device communicatively connected to the cloud-based analytics platform, of a suggested action to be carried out in the environment.

13. The cloud-based surveillance system of claim 12 , wherein the suggested action includes at least one of opening a new check-out line, moving an advertisement within the environment, or moving a presentation of articles within the environment.

14. The cloud-based surveillance system of claim 6 , wherein the input data includes 2-Dimensional (20) images and/or videos of the environment.

15. The cloud-based surveillance system of claim 12 , wherein generating the 3D representation of the environment comprises:

determining a common object between an image or video captured by a first ICD and an image or video captured by a second ICD; and

triangulating the position of the common object to determine depth Information for the input data.

16. The cloud-based surveillance system of claim 6 , wherein the memory further contains instructions that cause the at least one processor to generate an alert based, at least in part, on a preset rule and the generated pattern of movement.

17. The cloud-based surveillance system of claim 6 , wherein the cloud-based analytics platform is configured to communicatively communicate with at least one user device associated with an authorized account.

18. The cloud-based surveillance system of claim 6 , wherein the at least two ICDs are configured for wireless cross-communication with each other independent of the cloud-based analytics platform, wherein the cross-communication of the at least two ICDs provides for data exchange of at least one of information about the environment, settings of the ICDs, or input data captured from the environment.

19. A method of cloud-based surveillance for an environment, comprising:

configuring a plurality of input capture devices (ICDs) for network-based communication with a cloud-based analytics platform, wherein each of the ICDs includes a visual sensor for capturing input data from the environment, and wherein the ICDs are configured to transmit the input data to the cloud-based analytics platform via a network;

receiving the captured input data from the ICDs;

generating a 3-Dimensional (3D) visual representation of the environment based, at least in part, on the captured input data from the ICDs;

performing analytics based, at least in part, on the captured input data and the generated 3D visual representation; and

generating a pattern of object movement within the environment based, at least in part, on results of the analytics.

20. The method of claim 19 , wherein the input data includes at least one of live streaming video, real-time images and/or audio, previously recorded video, or previously captured images and/or audio.

21. The method of claim 19 , further comprising providing a user device access to the cloud-based analytics platform based, at least in part, on an authorized account.

22. The method of claim 21 , wherein the user device is at least one of a smart phone, tablet, personal computer, or laptop computer.

23. The method of claim 22 , further comprising sending an alert and/or a message to a user device based, at least in part, on the generated pattern of object movement and a preset setting for user detection.

Assignments (11)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2024
From: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
To: TYCO FIRE & SECURITY GMBH
Reel/Frame 068494/0384 →
NUNC PRO TUNC ASSIGNMENT Recorded Feb 4, 2022
From: SENSORMATIC ELECTRONICS, LLC
To: JOHNSON CONTROLS US HOLDINGS LLC
Reel/Frame 058957/0138 →
NUNC PRO TUNC ASSIGNMENT Recorded Feb 4, 2022
From: JOHNSON CONTROLS US HOLDINGS LLC
To: JOHNSON CONTROLS, INC.
Reel/Frame 058955/0394 →
NUNC PRO TUNC ASSIGNMENT Recorded Feb 4, 2022
From: JOHNSON CONTROLS, INC.
To: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
Reel/Frame 058955/0472 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2021
From: SENSORMATIC ELECTRONICS LLC
To: JOHNSON CONTROLS US HOLDINGS LLC
Reel/Frame 058600/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2021
From: JOHNSON CONTROLS INC
To: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
Reel/Frame 058600/0126 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2021
From: JOHNSON CONTROLS US HOLDINGS LLC
To: JOHNSON CONTROLS INC
Reel/Frame 058600/0080 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2018
From: RENKIS, MARTIN
To: SMARTVUE CORPORATION
Reel/Frame 046866/0834 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 10, 2018
From: RENKIS, MARTIN
To: KIP SMRT P1 LP
Reel/Frame 046827/0840 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2018
From: KIP SMRT P1 LP
To: SENSORMATIC ELECTRONICS, LLC
Reel/Frame 045817/0353 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2017
From: SMARTVUE CORPORATION
To: KIP SMRT P1 LP
Reel/Frame 044156/0749 →
Continuity (54)
Continuation In Part 15220445 · Jul 27, 2016
Continuation 14845475 · Sep 4, 2015
Continuation In Part 14429687 · Mar 19, 2015
Continuation In Part 15369619
Continuation In Part 14249687 · Apr 10, 2014
Continuation In Part 14845417 · Sep 4, 2015
Continuation In Part 14249687 · Apr 10, 2014
Continuation In Part 15369619
Continuation In Part 14845423 · Sep 4, 2015
Continuation In Part 14249687 · Apr 10, 2014
Continuation In Part 15369619
Continuation In Part 14845433 · Sep 4, 2015
Continuation In Part 14249687 · Apr 10, 2014
Continuation In Part 15369619
Continuation In Part 14926189 · Oct 29, 2015
Continuation In Part 14845423 · Sep 4, 2015
Continuation In Part 14249687 · Apr 10, 2014
Continuation In Part 14845433 · Sep 4, 2015
Continuation In Part 14249687 · Apr 10, 2014
Continuation In Part 15369619
Continuation In Part 14976584 · Dec 21, 2015
Continuation In Part 14845417 · Sep 4, 2015
Continuation In Part 14249687 · Apr 10, 2014
Continuation In Part 15369619
Continuation In Part 15220449 · Jul 27, 2016
Continuation In Part 14865684 · Sep 25, 2015
Continuation In Part 14504132 · Oct 1, 2014
Continuation In Part 14249687 · Apr 10, 2014
Continuation In Part 15369619
Continuation In Part 15220453 · Jul 27, 2016
Continuation 14882896 · Oct 14, 2015
Continuation 14504132 · Oct 1, 2014
Continuation In Part 14249687 · Apr 10, 2014
Continuation In Part 15369619
Continuation In Part 15220456 · Jul 27, 2016
Continuation 14845439 · Sep 4, 2015
Continuation In Part 14249687 · Apr 10, 2014
Continuation In Part 15369619
Continuation In Part 15220463 · Jul 27, 2016
Continuation 14845458 · Sep 4, 2015
Continuation In Part 14249687 · Apr 10, 2014
Continuation In Part 15369619
Continuation In Part 15228354 · Aug 4, 2016
Continuation 14845446 · Sep 4, 2015
Continuation In Part 14249687 · Apr 10, 2014
Continuation In Part 15369619
Continuation In Part 15228374 · Aug 4, 2016
Continuation 14845464 · Sep 4, 2015
Continuation In Part 14249687 · Apr 10, 2014
Continuation In Part 15369619
Continuation In Part 15241451 · Aug 19, 2016
Continuation 14845480 · Sep 4, 2015
Continuation In Part 14249687 · Apr 10, 2014
Related Publication 20170300758A1 · Oct 19, 2017
Cited By (1)
US 12,300,030