IP Library › Granted Patent US 10,733,405
Granted Patent B2
US 10,733,405 · App. 15/884,881 · Granted Aug 4, 2020

Real-time three-dimensional (3D) shape validation

Inventor: Christopher John Costello (Suwanee, GA)
Assignee: NCR Corporation
G06K7/1413G06K7/10722G06T7/13G06T7/60H04N7/188H04N13/204G06Q20/18G06Q20/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,733,405
App. No.
15/884,881
Granted
Aug 4, 2020
Kind
B2
Abstract

A three-dimensional image (3D) image for a shape of an orientation of an item is captured when an item barcode for the item is captured by a scanner during item checkout at a terminal. Edges for the shape and dimensions for the shape are calculated from the 3D image based on the orientation. The shape dimensions are compared against expected dimensions for a candidate item that is identified from item information in the item barcode and a decision is made as to whether to validate the item barcode for the item during item checkout or as to whether to invalidate the item barcode and suspend item checkout at the terminal for an audit of the item checkout.

Claims (33)

1. A method, comprising:

calculating dimensions of a shape for an item from a three-dimensional (3D) image of the item based on one or more expected orientations of a candidate item identified in an item barcode scanned from the item when the 3D image is captured, wherein each of the one or more expected orientations are based on known locations on the item where the item barcode is present and a known field-of-view of a 3D camera that captures the 3D image;

comparing the shape and the dimensions against an expected shape and expected dimensions associated with the candidate item; and

validating or invalidating the item during item checkout based on the comparing.

2. The method of claim 1 , wherein calculating further includes activating the 3D camera to capture the 3D image when a scanner scans the item barcode from a surface of the item.

3. The method of claim 2 , wherein activating further includes activating the 3D camera as a peripheral camera interfaced to the scanner and situated overhead of a scanner surface of the scanner.

4. The method of claim 2 , wherein activating further includes activating the 3D camera as an integrated camera that is integrated into the scanner.

5. The method of claim 1 , wherein calculating further includes identifying edges of the shape from depth values provided with the 3D image.

6. The method of claim 5 , wherein identifying further includes calculating the dimensions for the shape based on the edges.

7. The method of claim 1 , wherein calculating further includes obtaining the expected orientations from a database using an item identifier acquired from the item barcode.

8. The method of claim 7 , wherein comparing further includes obtaining the expected shape and expected dimensions from the database using the item identifier.

9. The method of claim 1 further comprising providing item details obtained from the item barcode to a transaction manager when the shape and dimensions for the item match the expected shape and the expected dimensions for the candidate item.

10. The method of claim 1 further comprising, sending an alert to a transaction manager when the shape and the dimensions for the item does not match the expected shape and the expected dimensions for the candidate item.

11. The method of claim 10 , wherein sending further includes suspending or halting a checkout transaction being processed by the transaction manager in response to the alert.

12. A method, comprising:

scanning an item barcode when the item barcode is passed in front of a camera of a scanner;

capturing a three-dimensional (3D) image of the item in response to the scanning by a 3D camera;

obtaining expected orientations for the 3D image using an item identifier acquired from the item barcode and linked to a candidate item, wherein each of the expected orientations are based on known locations on the item where the item barcode is present and a known field-of-view of the 3D camera that captures the 3D image;

calculating dimensions for the item from the 3D image based on the expected orientations;

acquiring expected dimensions for the candidate item for one of the expected orientations using the item identifier; and

making a determination as to whether to validate the item for an ongoing transaction at a terminal or as to whether to invalidate the item for the ongoing transaction based on a comparison between the dimensions for the item and the expected dimensions for the candidate item in the one of the expected orientations.

13. The method of claim 12 , wherein capturing further includes triggering activation of the 3D camera when the item barcode is captured by the scanner.

14. The method of claim 12 , wherein calculating further includes processing edge detection on the 3D image identifying a shape from detected edges.

15. The method of claim 14 , wherein processing further includes matching the shape to the one of the orientations.

16. The method of claim 15 , wherein matching further includes calculating the dimensions from depth values provided in the 3D image, the shape, and the detected edges.

17. The method of claim 12 further comprising halting or suspending the ongoing transaction when the determination is to invalidate the item during the ongoing transaction.

18. The method of claim 12 further comprising, providing item details obtained using the item barcode to a transaction manager for continued processing of the ongoing transaction when the determination is to validate the item during the ongoing transaction.

19. A system, comprising:

a terminal configured to processing item transactions;

a three-dimensional (3D) camera configured to capture 3D images of items when item barcodes are scanned from the items during the item transactions; and

a 3D shape validator configured to:

i) match orientations for the items in the 3D items to expected orientations of the items when the item barcodes are scanned based on known locations on the items where the item barcodes are present and a known field-of-view of a 3D camera that captures the 3D image, ii) determine shapes of the items from the expected orientations, iii) calculate dimensions for the shapes from depth values provided in the 3D images and the shapes, and iv) determine whether to validate or invalidate the items based on a comparison of the dimensions to expected dimensions for candidate items identified by using the item barcodes in real time during the item transactions.

20. The system of claim 19 , wherein the terminal is one of: Self-Service Terminal (SST) and a cashier-assisted Point-Of-Sale (POS) terminal.

Assignments (6)
CHANGE OF NAME Recorded Dec 7, 2023
From: NCR CORPORATION
To: NCR VOYIX CORPORATION
Reel/Frame 065820/0704 →
RELEASE OF PATENT SECURITY INTEREST Recorded Oct 25, 2023
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: NCR VOYIX CORPORATION
Reel/Frame 065346/0531 →
SECURITY INTEREST Recorded Oct 25, 2023
From: NCR VOYIX CORPORATION
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 065346/0168 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PROPERTY NUMBERS SECTION TO REMOVE PATENT APPLICATION: 15000000 PREVIOUSLY RECORDED AT REEL: 050874 FRAME: 0063. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Apr 12, 2021
From: NCR CORPORATION
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 057047/0161 →
SECURITY INTEREST Recorded Oct 29, 2019
From: NCR CORPORATION
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 050874/0063 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2018
From: COSTELLO, CHRISTOPHER JOHN
To: NCR CORPORATION
Reel/Frame 044786/0201 →
Continuity (1)
Related Publication 20200143130A1 · May 7, 2020