Event detection based on video metadata
Video data from sources, such as cameras, is analyzed to create metadata descriptive of the events and objects occurring in the video. This metadata, which consists of data about the video, is then analyzed on a transaction basis to determine if a suspicious activity, such as a fraudulent Point of Sale (POS) return event, has occurred in relation to a transaction.
1. A system for analyzing video metadata relating to one or more transactions at a point-of-sale (POS) device, the system comprising one or more processors and one or more storage devices cooperating to:
receive a feed of video metadata containing information about a video stream corresponding to video events occurring at a customer POS region and video events occurring at a cashier POS region;
select and execute one or more of a plurality of metadata analysis techniques on the video metadata to identify the presence or absence of a customer at the customer POS region during a time window corresponding to a return transaction;
wherein the one or more selected and executed metadata analysis techniques include at least an inclusion technique that, for a particular transaction, returns an indication of no fraud if an object present in the video metadata, during the time window associated with the return transaction, is determined to overlap with the customer POS region by more than a predetermined percentage of the customer POS region.
2. A system according to claim 1 , wherein the metadata includes information descriptive of objects and events in the video at the POS.
3. A system according to claim 2 , wherein the metadata includes information relating to one or more of position, relative size, and movements of an object detected in the video.
4. A system according to claim 3 , wherein a detection of the absence of a customer at the POS location associated with the customer is an indication of fraud, the system further comprising a poster application that posts a report of fraud to the POS location upon a detection of fraud.
5. A system according to claim 4 , wherein the one or more selected and executed metadata analysis techniques further include a mutual exclusion technique that, for a particular transaction, returns an indication of fraud if an object present in the cashier POS region overlaps the customer POS region by more than a predetermined percentage.
6. A system according to claim 5 , wherein objects associated with transactions from a first return lane are analyzed using the inclusion technique, and objects associated with transactions associated with a second return lane are analyzed using the mutual exclusion technique.
7. A system according to claim 5 , wherein objects associated with transactions recorded from a first camera are analyzed using the inclusion technique, and objects associated with transactions recorded from a second camera are analyzed using the mutual exclusion technique.
8. A method for analyzing video metadata relating to one or more transactions at a point-of-sale (POS) device via a system comprising one or more processors and one or more storage devices, the method comprising:
receiving a feed of video metadata containing information about a video stream corresponding to video events occurring at a customer POS region and video events occurring at a cashier POS region;
selecting and executing one or more of a plurality of metadata analysis techniques on the video metadata to identify the presence or absence of a customer at the customer POS region during a time window corresponding to a return transaction;
wherein the one or more selected and executed metadata analysis techniques include at least an inclusion technique that, for a particular transaction, returns an indication of no fraud if an object present in the video metadata, during the time window associated with the return transaction, is determined to overlap with the customer POS region by more than a predetermined percentage of the customer POS region.
9. A method according to claim 8 , wherein the metadata includes information descriptive of objects and events in the video at the POS.
10. A method according to claim 9 , wherein the metadata includes information relating to one or more of position, relative size, and movements of an object detected in the video.
11. A method according to claim 10 , wherein a detection of the absence of a customer at the POS location associated with the customer is an indication of fraud, the system further comprising a poster application that posts a report of fraud to the POS location upon a detection of fraud.
12. A method according to claim 11 , wherein the one or more selected and executed metadata analysis techniques further include:
a mutual exclusion technique that, for a particular transaction, returns an indication of fraud if an object present in the cashier POS region overlaps the customer POS region by more than a predetermined percentage.
13. A method according to claim 12 , wherein objects associated with transactions from a first return lane are analyzed using the inclusion technique, and objects associated with transactions associated with a second return lane are analyzed using the mutual exclusion technique.
14. A method according to claim 12 , wherein objects associated with transactions recorded from a first camera are analyzed using the inclusion technique, and objects associated with transactions recorded from a second camera are analyzed using the mutual exclusion technique.