IP Library Granted Patent US 11,238,554
Granted Patent B2
US 11,238,554 · App. 16/724,560 · Granted Feb 1, 2022

Frictionless security monitoring and management

Inventors: Matthew Robert Burris (Atlanta, GA); Christopher John Costello (Suwanee, GA); Gregory Joseph Hartl (Atlanta, GA); Sudip Rahman Khan (Decatur, GA)
Assignee: NCR Corporation
G06Q50/265G06K9/00288G06K9/00335G06Q30/0281G08B21/02G10L15/18G10L15/22H04W8/22H04W12/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,238,554
App. No.
16/724,560
Granted
Feb 1, 2022
Kind
B2
Abstract

Zones are defined within an enterprise. Video captured from the zones are monitored for threats (financial or physical). Any transaction data associated with transactions are monitored with the video along with sensor data captured from sensors within the zones. Threat policies are evaluated to identify actions and behaviors of individuals within the zones and threat scores are maintained. When a current threat score associated with a specific type of threat for a given individual or set of individuals exceeds a threshold, one or more automated remediation or threat avoidance actions are processed to mitigate and/or prevent the perceived threat.

Claims (30)

1. A method, comprising:

providing executable instructions to a processor of a device from a non-transitory computer-readable storage medium causing the processor to perform operations comprising:

presenting an interactive interface to define a zone and threat policies within the zone;

receiving from the interactive interface an outline that is superimposed and drawn on top of an image or a video captured by a camera;

obtaining from the interactive interface objects representing assets and structures that are placed in positions within the outline;

assigning a zone identifier to the outline and object identifiers for the objects to the zone identifier;

acquiring the threat policies based on a zone type and object types received from the interactive interface;

generating a zone definition using: the camera, the outline, the zone identifier, placement and orientation of the objects within the outline, the object identifiers, the zone type, the object types, and the threat policies;

monitoring an area defined by the outline and the zone definition within a video feed provided by the camera for interactions of individuals present within the area and the objects based on the threat policies by analyzing pixels in the at least one video feed and tracking the object identifiers for the objects within a zone associated with the zone identifier, individual identifiers for the individuals within the zone, locations of the individuals within the zone, and assigning action identifiers or behavior identifiers for actions or behaviors of the individuals within the zone;

performing biometric recognition on the pixels associated with the individuals identified in the video feed and associating at least one individual associated with at least one of the individual identifiers with an enterprise-maintained identifier that is known to or registered with an enterprise based on the performing;

maintaining a current threat score based on the interactions determined from the action identifiers or behavior identifiers of the individuals within the zone and based on the threat policies; and

processing at least one mitigation action when the current threat score exceeds a threshold value indicating a presence of a threat within the area that defines the zone.

2. The method of claim 1 , wherein acquiring further includes obtaining modifications from the interactive interface to the threat policies.

3. The method of claim 2 , wherein obtaining further includes obtaining from the interactive interface at least one custom-defined threat policy.

4. The method of claim 3 , wherein obtaining further includes receiving an authorization for the modifications and the at least one custom-defined threat policy from an authorized individual or an authorization system.

5. The method of claim 1 , wherein processing further includes identifying the theft as a financial theft or a physical threat of violence.

6. The method of claim 1 , wherein processing further includes process the at least one mitigation action as one or more of: flagging of an account or a particular individual associated with the interactions, sending an alarm to authorities that identifies the threat, sending a notification of the threat to a security system, indexing the interactions to the video feed and producing a video clip of the threat, and sending the video clip to a reviewer for real-time review of the threat.

7. A system, comprising:

cameras configured to capture videos in public areas and private areas of an establishment;

a transaction system configured to process transactions of the establishment;

a server comprising a processor and a non-transitory computer-readable storage medium;

the non-transitory computer-readable storage medium comprising executable instructions representing an autonomous threat controller;

the autonomous threat controller when executed on the processor from the non-transitory computer-readable storage medium causing the processor to perform processing comprising:

monitoring individuals and objects present in the videos based on zones defined from the public areas and the private areas by analyzing pixels in the at least one video feed and tracking the individuals, locations of the individuals within the zones, actions of the individuals or behaviors of the individuals, and the objects within the zone using individual identifiers for the individuals, action identifiers for the actions or behavior identifiers for the behaviors, zone identifiers for the zones, and object identifiers for the objects;

performing biometric recognition on the pixels associated with the individuals identified in the videos and associating at least one individual associated with at least one of the individual identifiers with an enterprise-maintained identifier that is known to or registered with an enterprise based on the performing;

determining based on the behaviors or the actions of the individuals with respect to one another or with respect to the objects and based on transaction data provided from the transaction system when a threat is present based on the threat policies; and

process at least one mitigation action based on a threat type associated with the threat, wherein the at least one mitigation action includes sending an alert to a security system when the threat type is associated with a physical threat of violence.

8. The system of claim 7 , wherein the autonomous threat controller when executed on the processor from the non-transitory computer-readable storage medium further causing the processor to perform additional processing comprising one or more of:

engaging at least one of the individuals in a natural language voice dialogue to explain the threat and appropriate actions that are to be taken;

activating one or more sensors to collect sensor data relevant to a particular individual and the threat.

Assignments (3)
CHANGE OF NAME Recorded Dec 7, 2023
From: NCR CORPORATION
To: NCR VOYIX CORPORATION
Reel/Frame 065820/0704 →
SECURITY INTEREST Recorded Oct 25, 2023
From: NCR VOYIX CORPORATION
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 065346/0168 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2019
From: BURRIS, MATTHEW ROBERT; COSTELLO, CHRISTOPHER JOHN; HARTL, GREGORY JOSEPH; KHAN, SUDIP RAHMAN
To: NCR CORPORATION
Reel/Frame 051353/0001 →
Continuity (2)
Continuation In Part 16696870 · Nov 26, 2019
Related Publication 20210158465A1 · May 27, 2021