IP Library Granted Patent US 11,227,353
Granted Patent B2
US 11,227,353 · App. 15/946,359 · Granted Jan 18, 2022

Providing security and customer service using video analytics and location tracking

Inventors: Graeme Laycock (Hunters Hill, AU); Alyanna Agda (North Rocks, AU); Kendall Paix (Cherrybrook, AU); Andrew Arlen (North Rocks, AU); Samir Dudani (Sydney, AU)
Assignee: HONEYWELL INTERNATIONAL INC.
G06Q50/265G06K9/00288G06K9/00718G06K9/00771G06Q10/06311G06Q10/06316
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,227,353
App. No.
15/946,359
Granted
Jan 18, 2022
Kind
B2
Abstract

Devices, methods, and systems for providing security and customer service using video analytics and location tracking are described herein. One device includes a memory, and a processor configured to execute executable instructions stored in the memory to identify, using video analytics, security incidents occurring in a facility and customer service opportunities occurring in the facility, determine, upon identifying a security incident occurring in the facility, a workflow sequence for responding to the security incident, determine, upon identifying a customer service opportunity occurring in the facility, a workflow sequence for responding to the customer service opportunity, display the workflow sequence for responding to the security incident on a first user interface, and display the workflow sequence for responding to the customer service opportunity on a second user interface.

Claims (50)

1. A computing device for providing security and customer service for a facility having one or more cameras, comprising:

a memory; and

a processor configured to execute executable instructions stored in the memory to:

receive images and/or videos captured by the one or more cameras of the facility;

apply video analytics to the received images and/or videos in order to identify security incidents occurring in the facility and to capture from the images and/or videos a picture of a person of interest in the identified security incidents and to identify customer service opportunities occurring in the facility and to capture from the images and/or videos a picture of a person of interest in the identified customer service opportunities, wherein the video analytics include performing one or more of facial recognition, demographic analysis and detection of unattended objects;

determine a priority level for each of the identified security incidents and the identified customer service opportunities;

prioritize deployment of staff within the facility in accordance with the priority level for each of the identified security incidents and the identified customer service opportunities;

monitor current locations of staff within the facility using real time location tracking, wherein the real time location tracking comprises using a plurality of beacons, where the plurality of beacons are located at different respective locations in the facility;

determine, upon identifying by the video analytics a security incident occurring in the facility, a workflow sequence for responding to the security incident including identifying an appropriate staff member to respond to the security incident based at least in part upon the deployment prioritization for the identified security incident and the staff member's current location within the facility;

determine, upon identifying by the video analytics a customer service opportunity occurring in the facility, a workflow sequence for responding to the customer service opportunity including identifying an appropriate staff member to respond to the customer service opportunity based at least in part upon the deployment prioritization for the identified customer service opportunity and the staff member's current location within the facility;

transmit the workflow sequence for responding to the security incident and the picture of a person of interest in the identified security incident for display on a first user interface corresponding to a mobile device carried by the appropriate staff member for responding to the security incident;

and transmit the workflow sequence for responding to the customer service opportunity and the picture of a person of interest in the identified customer service opportunity for display on a second user interface corresponding to a mobile device carried by the appropriate staff member for responding to the customer service opportunity.

2. The computing device of claim 1 , wherein the video analytics includes facial recognition of people in the facility.

3. The computing device of claim 1 , wherein the video analytics includes detection of unattended objects in the facility.

4. The computing device of claim 1 , wherein the workflow sequence for responding to the security incident and the workflow sequence for responding to the customer service opportunity each include:

an action performed automatically by the computing device; and

an action performed manually by staff in the facility.

5. The computing device of claim 1 , wherein the processor is configured to execute the instructions to:

send, upon identifying the security incident occurring in the facility, a location of the security incident and directions to the location of the security incident to the mobile device carried by the staff member determined to be the appropriate staff member to respond to the security incident; and

send, upon identifying the customer service opportunity occurring in the facility, a location of the customer service opportunity and directions to the location of the customer service opportunity to the mobile device carried by the staff member determined to be the appropriate staff member to respond to the customer service opportunity.

6. A method for providing security and customer service using a computing device, comprising:

the computing device receiving images and/or videos captured by one or more cameras of a facility;

the computing device applying video analytics to the received images and/or videos in order to identify security incidents occurring in the facility and to capture from the images and/or videos a picture of a person of interest in the identified security incidents and to identify customer service opportunities occurring in the facility and to capture from the images and/or videos a picture of a person of interest in the identified customer service opportunities, wherein the video analytics include performing one or more of facial recognition, demographic analysis and detection of unattended objects;

the computing device determining a priority level for each of the identified security incidents and the identified customer service opportunities;

the computing device prioritizing deployment of staff within the facility in accordance with the priority level for each of the identified security incidents and the identified customer service opportunities;

the computing device monitoring current locations of staff within the facility using real time location tracking comprising a plurality of beacons, where the plurality of beacons are located at different respective locations in the facility;

for the identified security incident, the computing device determining an appropriate staff member to respond to the identified security incident based at least in part upon the deployment prioritization for the identified security incident and the staff member's current location within the facility; and

the computing device transmitting instructions for responding to the identified security incident for display on a display of a mobile device carried by the appropriate staff member for responding to the security incident along with the picture of the person of interest in the identified security incident; and

for the identified customer service opportunity, the computing device determining an appropriate staff member to respond to the identified customer service opportunity based at least in part upon the deployment prioritization for the identified customer service opportunity and the staff member's current location within the facility; and

the computing device transmitting instructions for responding to the identified customer service opportunity for display on a display of a mobile device carried out by the appropriate staff member for responding to the customer service opportunity along with the picture of the person of interest in the identified customer service opportunity.

7. The method of claim 6 , wherein:

the computing device determining the appropriate staff member for responding to the identified security incident includes determining the staff member closest to the identified security incident; and

the computing device determining the appropriate staff member for responding to the identified customer service opportunity includes determining the staff member closest to the identified customer service opportunity.

8. The method of claim 6 , wherein the method includes the computing device identifying the current locations of the staff in the facility on a map of a floorplan of the facility.

9. The method of claim 8 , wherein the map includes a heat mapping of current occupancy levels in the facility.

10. The method of claim 6 , wherein the real time location tracking is performed using a plurality of beacons, where the plurality of beacons are located at different respective locations in the facility.

11. A non-transitory computer readable medium having computer readable instructions stored thereon that are executable by a processor to:

monitor current locations of staff members within a facility using real time location tracking, wherein the real time location tracking comprises using a plurality of beacons, where the plurality of beacons are located at different respective locations in the facility;

applying video analytics on received images and/or videos captured by one or more cameras of a facility to identify security incidents occurring in the facility and to capture a picture of a person of interest in the identified security incidents and to identify customer service opportunities occurring in the facility and to capture a picture of a person of interest in the identified customer service opportunities, wherein the video analytics include performing one or more of facial recognition, demographic analysis and detection of unattended objects;

determine a priority level for each of the identified security incidents and the identified customer service opportunities;

upon identifying by the video analytics a security incident occurring in the facility: determine an appropriate staff member to respond to the identified security incident based at least in part upon the deployment prioritization of the identified security incident and the staff member's current location within the facility; and

transmit instructions for responding to the identified security incident and the picture of the person of interest in the identified security incident for display on a display of a mobile device carried by the appropriate staff member for responding to the security incident; and

upon identifying by the video analytics a customer service opportunity occurring in the facility:

determine an appropriate staff member to respond to the identified customer service opportunity based at least in part upon the deployment prioritization of the identified customer service opportunity and the staff member's current location within the facility; and

transmit instructions for responding to the identified customer service opportunity and the picture of the person of interest in the identified customer service opportunity for display on a display of a mobile device carried by the appropriate staff member for responding to the customer service opportunity.

12. The non-transitory computer readable medium of claim 11 , wherein the identified customer service opportunity corresponds to a person identified as a VIP entering the facility.

13. The non-transitory computer readable medium of claim 11 , wherein the identified security incident corresponds to a person identified as a blacklisted individual entering the facility.

14. The non-transitory computer readable medium of claim 11 , wherein the identified security incident corresponds to an unauthorized person attempting to enter a secure area.

15. The non-transitory computer readable medium of claim 11 , wherein the identified security incident corresponds to an unattended object in the facility.

16. The non-transitory computer readable medium of claim 11 , wherein the identified security incident corresponds to a fire evacuation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2018
From: LAYCOCK, GRAEME; AGDA, ALYANNA; PAIX, KENDALL; ARLEN, ANDREW; DUDANI, SAMIR
To: HONEYWELL INTERNATIONAL INC.
Reel/Frame 045450/0764 →
Continuity (1)
Related Publication 20190311451A1 · Oct 10, 2019