Method and apparatus for detecting suspicious activity using video analysis
A system detects a transaction outcome by obtaining video data associated with a transaction area and analyzing the video data to obtain at least one video transaction parameter concerning transactions associated with the transaction area. The transaction area can be a video count of items indicated in the video data as detected by an automated item detection algorithm applied to the video data. The system obtains at least one expected transaction parameter concerning an expected transaction that occurs in the transaction area, such as a scan count of items scanned at a point of sale terminal. The system automatically compares the video transaction parameter(s) to the expected transaction parameter(s) to identify a transaction outcome that may indicate fraudulent activity such as sweethearting in a retail environment.
1. A system, comprising:
a camera to stream video of a transaction area during a transaction;
a transaction terminal comprising a scanner to scan item codes as items are recorded for the transaction within the transaction terminal;
a server comprising a processor and a non-transitory computer-readable storage medium;
the non-transitory computer-readable storage medium comprises executable instructions;
the executable instructions when executed by the processor from the non-transitory computer-readable storage medium cause the processor to perform operations comprising:
tracking from the video each item as the corresponding item moves through an input region of the transaction area, a scan region of the transaction area, and an output region of the transaction area;
identifying item identifiers for each item from the video;
maintaining total region counts for each item identifier based on the tracking;
obtaining transaction details comprising processed item identifiers from the transaction terminal for each item recorded in the transaction by the scanner or entered by an operator of the transaction terminal and the transaction details comprising a total item count for scanned items and entered items of the transaction; and
raising an alert for the transaction when the total region counts for a given item identifier are not equal, when a total output region count for the given item identifier is greater than a total scan region count for the corresponding given item identifier, when the total output region count for all of the item identifiers is greater than the total item count obtained from the transaction terminal, when a specific item identifier is missing from the processed item identifiers, or when a specific processed item identifier is missing from the item identifiers.
2. The system of claim 1 , wherein the executable instructions when executed by the processor from the non-transitory computer-readable storage medium further cause the processor to perform operations comprising:
providing one or more video clips of the video with the alert, wherein the one or more video clips identify one or more suspicious activities in the video based discrepancies detected between the video and the transaction details recorded by the transaction terminal.