IP Library Granted Patent US 12,262,148
Granted Patent B2
US 12,262,148 · App. 17/952,578 · Granted Mar 25, 2025

Mechanism for video review at a self-checkout terminal

Inventors: Joshua Migdal (Wayland, MA); Chris Wible (Cambridge, MA); Malay Kundu (Lexington, MA)
Assignee: NCR Voyix Corporation
H04N7/181G06Q20/20G06Q20/203G06Q20/208G07G1/0072G07G3/003G08B13/19673G08B13/19682G06T2207/30232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,262,148
App. No.
17/952,578
Granted
Mar 25, 2025
Kind
B2
Abstract

A system and method for replaying a security video at the time of a fraudulent incident at a point-of-sale checkout terminal is presented. The video playback takes place in real-time, when the event occurs, allowing personnel to take appropriate measures, corrective or otherwise, to deal with the event. Examples of such events may include when a weight-based security alert is triggered at a self-checkout, when a cashier or customer has missed scanning an item at the checkout, or other possible events where rapid replay of relevant video is required.

Claims (27)

1. A method, comprising:

receiving transaction events from a terminal during transactions at the terminal, wherein receiving further includes streaming a live feed of a video for the transactions to a display;

generating, during a given transaction, a weight mismatch event for an item of the given transaction when an item weight for the item deviates from an expected weight of the item;

recording a time associated with the generating;

matching the time to a timestamp in the video captured for the given transaction;

obtaining a portion of the video that precedes the timestamp by a first amount of time and that follows the timestamp by a second amount of time;

providing the portion of the video for playback associated with the weight mismatch event, wherein providing further includes interrupting the live feed and presenting the portion for playback on the display; and

transitioning back to streaming the live feed of the video after playback of the portion on the display; and

modulating a speed of at least a portion of the playback as a function of a temporal proximity to the time associated with the weight mismatch event, wherein the speed is decelerated as the playback approaches the time associated with the weight mismatch event.

2. A method, comprising:

receiving transaction events from a terminal during transactions at the terminal;

generating, during a given transaction, a weight mismatch event for an item of the given transaction when an item weight for the item deviates from an expected weight of the item;

recording a time associated with the generating;

matching the time to a timestamp in a video captured for the given transaction;

obtaining a portion of the video that precedes the timestamp by a first amount of time and that follows the timestamp by a second amount of time, wherein obtaining further includes identifying the first amount of time as a predetermined constant offset of time that precedes the timestamp, wherein identifying further includes identifying the second amount of time as a predetermined duration of time that begins at first amount of time that precedes the timestamp and continues for the predetermined duration of time; and

providing the portion of the video for playback associated with the weight mismatch event, wherein providing further includes transitioning the video being presented on a display for playback of the portion to a live feed after the predetermined duration expires for playback of the portion on the display; and

modulating a speed of the playback as a function of a temporal proximity to a transaction time, wherein the speed is decelerated as the playback gets closer to the transaction time.

3. The method of claim 1 , wherein obtaining further includes identifying the first amount of time as a start time for the given transaction based on a start transaction event and corresponding time received when the given transaction started.

4. The method of claim 1 , wherein obtaining further includes identifying the second amount of time based on a requested time associated with a request for playback of the portion during the given transaction.

5. The method of claim 1 , wherein generating further includes obtaining an item identifier for the item from an item scan event for the item during the given transaction and obtaining the expected weight of the item using the item identifier to search a data store and obtain the expected weight.

6. The method of claim 1 , wherein generating further includes obtaining the item weight of the item for the weight mismatch event from a weight sensor associated with the checkout terminal.

7. A method, comprising: monitoring transaction events during a transaction reported by a checkout terminal; maintaining a live stream of a video captured of a transaction area associated with the checkout terminal; streaming the live stream of the video to a display being monitored by an attendant during the transaction; identifying a mismatch event for an item from the transaction events based on transaction data for the transaction reported by the checkout terminal; generating a video clip from the video that starts at a first time that precedes an event time associated with the mismatch event by a first amount of time and that ends at a second time that extends beyond the first time or that extends beyond the event time by a second amount of time; interrupting the live stream of the video on the display and streaming the video clip to the display for viewing by the attendant; restoring the live stream of the video on the display once the video clip is played on the display by the attendant; and playing the video clip back at different rates, with a playback rate slowed down approaching a certain event of interest.

8. The method of claim 7 , wherein identifying further includes integrating the mismatch event into the transaction events.

9. The method of claim 7 , wherein identifying further includes identifying an item identifier from the transaction data associated with a scanned item event for the item.

10. The method of claim 9 , wherein identifying the item identifier further includes identifying an item weight from the transaction data associated with an item weight event for the item.

11. The method of claim 10 , wherein identifying further includes using the item identifier to search a data store and obtaining an expected item weight for the item.

12. The method of claim 11 , wherein using further includes identifying the mismatch event when the expected item weight for the item obtained from the data store does not comport with the item weight for the item obtained from the transaction data.

Assignments (4)
CHANGE OF NAME Recorded Nov 9, 2023
From: NCR CORPORATION
To: NCR VOYIX CORPORATION
Reel/Frame 065532/0893 →
SECURITY INTEREST Recorded Oct 25, 2023
From: NCR VOYIX CORPORATION
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 065346/0168 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2022
From: MIGDAL, JOSHUA; WIBLE, CHRIS; KUNDU, MALAY
To: STOPLIFT, INC.
Reel/Frame 061406/0763 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2022
From: STOPLIFT, INC.
To: NCR CORPORATION
Reel/Frame 061407/0019 →
Continuity (3)
Continuation 15708037 · Sep 18, 2017
Provisional Application 62396073 · Sep 16, 2016
Related Publication 20230020493A1 · Jan 19, 2023
References Cited (19)
US 7631808B2 · Kundu · 2009 [cited by examiner]
US 8146811B2 · Kundu · 2012 [cited by examiner]
US 8462212B1 · Kundu · 2013 [cited by examiner]
US 8570375B1 · Srinivasan · 2013 [cited by examiner]
US 9113051B1 · Scalisi · 2015 [cited by examiner]
US 20050110634A1 · Salcedo · 2005 [cited by examiner]
US 20050177859A1 · Valentino, III · 2005 [cited by examiner]
US 20070166001A1 · Barton · 2007 [cited by examiner]
US 20070212031A1 · Hikita · 2007 [cited by examiner]
US 20080226129A1 · Kundu · 2008 [cited by examiner]
US 20140176719A1 · Migdal · 2014 [cited by examiner]
US 20140338987A1 · Kobres · 2014 [cited by examiner]
US 20150121409A1 · Zhang · 2015 [cited by examiner]
US 20150193780A1 · Migdal · 2015 [cited by examiner]
US 20160210515A1 · Heier · 2016 [cited by examiner]
US 20160364123A1 · Burns · 2016 [cited by examiner]
US 20170251183A1 · Crooks · 2017 [cited by examiner]
US 20180068189A1 · Daliyot · 2018 [cited by examiner]
US 20180113577A1 · Burns · 2018 [cited by examiner]