IP Library Granted Patent US 9,426,428
Granted Patent B2
US 9,426,428 · App. 14/845,464 · Granted Aug 23, 2016

Systems and methods for automated cloud-based analytics and 3-dimensional (3D) display for surveillance systems in retail stores

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,426,428
App. No.
14/845,464
Granted
Aug 23, 2016
Kind
B2
Abstract

Systems and methods for cloud-based surveillance in a retail store is disclosed. At least two input capture devices and at least one user device are communicatively connected to a cloud-based analytics platform. The cloud-based analytics platform generates 3-Dimensional (3D) visual representation based on received 2-Dimensional (2D) video and/or image inputs, perform advanced analytics based on input data and generated 3D visual representation, and generates a graphical representation based on analytics data from advanced analytics. In one embodiment, the graphical representation is a heat map, which is an overlay of the 3D visual representation of the entire retail store.

Claims (35)

1. A cloud-based surveillance system for a target surveillance area, comprising:

at least two input capture devices (ICDs), a cloud-based analytics platform having a processor and a memory, and at least one user device having a display with a user interface;

wherein the cloud-based analytics platform is constructed and configured in network-based communication with the at least two ICDs and the at least one user device;

wherein each of the at least two ICDs has at least one visual sensor and is operable to capture and transmit input data to the cloud-based analytics platform;

wherein the cloud-based analytics platform is operable to:

generate 3-Dimensional (3D) visual representation of the target surveillance area based on the captured input data from the at least two ICDs;

perform analytics based on the captured input data and generated 3D visual representation;

generate a graphical representation of analytics data obtained from the analytics;

wherein the at least one user device is operable to display the graphical representation of the analytics data and 3D visual representation of the target surveillance area via the user interface;

wherein the 3D visual representation of the target surveillance area is overlaid with the graphical representation of analytics data.

2. The system of claim 1 , wherein the captured input data are selected from live streaming video, real-time images and/or audio, previously recorded video, previously captured images and/or audio, and combinations thereof.

3. The system of claim 1 , wherein the target surveillance area is a retail store, wherein the analytics comprises people counting and demographic analysis within the retail store, wherein the graphical representation of analytics data comprises a heat map of customer density within the retail store over a period of time.

4. The system of claim 3 , wherein the graphical representation of analytics data further comprises another heat map illustrating frequency of items being touched by customers.

5. The system of claim 3 , wherein the analytics further comprises optimizing store management and providing business intelligence.

6. The system of claim 1 , wherein the at least one user device is operable to access the cloud-based analytics platform for the target surveillance area with an authorized account via the user interface.

7. The system of claim 1 , wherein the at least one user device is selected from the group consisting of smart phones, tablets, personal computers, laptops, and head-mounted displays.

8. The system of claim 1 , wherein the 3D visual representation includes 3D playback for a predetermined period of time.

9. The system of claim 1 , wherein the 3D visual representation includes real-time or near-real-time streaming.

10. The system of claim 1 , wherein the 3D visual representation is interactive.

11. A cloud-based surveillance method, comprising:

communicatively connecting at least two input capture devices (ICDs) and at least one user device having a display with a user interface to a cloud-based analytics platform having a processor and a memory via communication network; wherein each of the at least two ICDs has at least one visual sensor;

the at least two ICDs capturing and transmitting input data to the cloud-based analytics platform;

the cloud-based analytics platform generating 3-Dimensional (3D) visual representation of the target surveillance area based on the captured input data from the at least two ICDs;

the cloud-based analytics platform performing analytics based on the captured input data and generated 3D visual representation;

the cloud-based analytics platform generating a graphical representation of analytics data obtained from the analytics;

the at least one user device displaying the graphical representation of the analytics data and 3D visual representation of the target surveillance area via the user interface; wherein the 3D visual representation of the target surveillance area is overlaid with the graphical representation of analytics data.

12. The method of claim 11 , wherein the captured input data are selected from live streaming video, real-time images and/or audio, previously recorded video, previously captured images and/or audio, and combinations thereof.

13. The method of claim 11 , wherein the target surveillance area is a retail store, wherein the analytics comprises people counting and demographic analysis within the retail store, wherein generating a graphical representation of analytics data comprises generating a heat map of customer density within the retail store over a period of time.

14. The method of claim 13 , wherein generating a graphical representation of analytics data further comprises another heat map illustrating frequency of items being touched by customers.

15. The method of claim 13 , wherein performing the analytics further comprises optimizing store management and providing business intelligence.

16. The method of claim 11 , wherein the at least one user device is operable to access the cloud-based analytics platform for the target surveillance area with an authorized account via the user interface.

17. The method of claim 11 , wherein the at least one user device is selected from the group consisting of smart phones, tablets, personal computers, laptops, and head-mounted displays.

18. The method of claim 11 , wherein the 3D visual representation includes 3D playback for a predetermined period of time.

19. The method of claim 11 , wherein the 3D visual representation includes real-time or near-real-time streaming.

20. The method of claim 11 , wherein the 3D visual representation is interactive.

Assignments (10)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2024
From: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
To: TYCO FIRE & SECURITY GMBH
Reel/Frame 068494/0384 →
NUNC PRO TUNC ASSIGNMENT Recorded Feb 4, 2022
From: SENSORMATIC ELECTRONICS, LLC
To: JOHNSON CONTROLS US HOLDINGS LLC
Reel/Frame 058957/0138 →
NUNC PRO TUNC ASSIGNMENT Recorded Feb 4, 2022
From: JOHNSON CONTROLS US HOLDINGS LLC
To: JOHNSON CONTROLS, INC.
Reel/Frame 058955/0394 →
NUNC PRO TUNC ASSIGNMENT Recorded Feb 4, 2022
From: JOHNSON CONTROLS, INC.
To: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
Reel/Frame 058955/0472 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2021
From: JOHNSON CONTROLS US HOLDINGS LLC
To: JOHNSON CONTROLS INC
Reel/Frame 058600/0080 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2021
From: SENSORMATIC ELECTRONICS LLC
To: JOHNSON CONTROLS US HOLDINGS LLC
Reel/Frame 058600/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2021
From: JOHNSON CONTROLS INC
To: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
Reel/Frame 058600/0126 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2018
From: KIP SMRT P1 LP
To: SENSORMATIC ELECTRONICS, LLC
Reel/Frame 045817/0353 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2016
From: SMARTVUE CORPORATION
To: KIP SMRT P1 LP
Reel/Frame 040817/0339 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2015
From: RENKIS, MARTIN A.
To: SMARTVUE CORPORATION
Reel/Frame 036562/0456 →