IP Library Granted Patent US 12,217,128
Granted Patent B2
US 12,217,128 · App. 18/088,771 · Granted Feb 4, 2025

Multiple field of view (FOV) vision system

Inventors: Edward Barkan (Miller Place, NY); Mark Drzymala (Saint James, NY); Darran Michael Handshaw (Sound Beach, NY)
Assignee: Zebra Technologies Corporation
G06K7/1447G06T7/70G06V10/44G06V10/761G06T2207/10024G06T2207/20081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,217,128
App. No.
18/088,771
Granted
Feb 4, 2025
Kind
B2
Abstract

Multiple field of view (FOV) systems are disclosed herein. An example system includes a bioptic barcode reader having a target imaging region. The bioptic barcode reader includes at least one imager having a first FOV and a second FOV and is configured to capture an image of a target object from each FOV. The example system includes one or more processors configured to receive the images and a trained object recognition model stored in memory communicatively coupled to the one or more processors. The memory includes instructions that, when executed, cause the one or more processors to analyze the images to identify at least a portion of a barcode and one or more features associated with the target object. The instructions further cause the one or more processors to determine a target object identification probability and to determine whether a predicted product identifies the target object.

Claims (35)

1. A barcode reader having a target object imaging region, the barcode reader comprising:

at least one imager having a first field of view (FOV) and a second FOV, wherein the at least one imager is configured to capture (i) a first image of a target object placed in a target imaging region within the first FOV and (ii) a second image of the target object within the second FOV;

one or more processors configured to receive the first image and the second image captured by the at least one imager; and

a memory communicatively coupled to the one or more processors, the memory storing instructions that, when executed by the one or more processors, cause the one or more processors to:

analyze the first image and the second image to identify at least a portion of a barcode associated with the target object in either the first image or the second image;

analyze the first image and the second image to identify one or more features associated with the target object in each of the first image and the second image;

determine a first target object identification for the target object based on the first image and a second target object identification for the target object based on the second image, wherein each of the first target object identification and the second target object identification is based on at least one of (i) the set of barcode data extracted from the at least the portion of the barcode, or (ii) the one or more features; and

responsive to determining that the first target object identification differs from the second target object identification, at least one of (i) generate a first alert for display to a user, (ii) generate a second alert for transmission to a remote monitoring system, or (iii) transmit a notification including the first target object identification and the second target object identification to a point-of-sale station.

2. The barcode reader of claim 1 , wherein the instructions, when executed by the one or more processors, further cause the one or more processors to:

generate a first set of target object identification probabilities based on the first image, wherein the first set of target object identification probabilities includes a first probability associating the target object with a predicted product;

generate a second set of target object identification probabilities based on the second image, wherein the second set of target object identification probabilities includes a second probability associating the target object with the predicted product; and

determine whether the predicted product identifies the target object by comparing the first probability and the second probability to the identification probability threshold.

3. The barcode reader of claim 1 , wherein the second FOV has a relative orientation with respect to the first FOV, the at least the portion of the barcode has a barcode orientation within either the first image or the second image, and wherein the instructions, when executed by the one or more processors, further cause the one or more processors to:

determine a target object identification probability for the target object based on (i) a set of barcode data extracted from the at least the portion of the barcode, (ii) the barcode orientation, (iii) the one or more features, or (iv) the relative orientation, wherein the target object identification probability associates the target object with a predicted product.

4. The reader of claim 3 , wherein the first FOV has a first central axis and the second FOV has a second central axis that is within 20 degrees of being substantially orthogonal to the first central axis.

5. The barcode reader of claim 4 , wherein one of the first central axis or the second central axis extends in a substantially horizontal direction away from the barcode reader, and wherein one of the first central axis and the second central axis extends in a substantially vertical direction away from the barcode reader.

6. The barcode reader of claim 4 , wherein the barcode reader has no other fields of view.

7. The barcode reader of claim 1 , wherein the at least one imager comprises one imager, and the barcode reader has no other imagers configured to capture the first image and the second image.

8. The barcode reader of claim 1 , wherein the one or more features includes at least one of (i) a graphic on the target object, (ii) an alphanumeric character on the target object, (iii) an edge of the target object, or (iv) a color of the target object.

9. A target object recognition method for a barcode reader having a target object imaging region, the method comprising:

capturing, with at least one imager of the barcode reader, a first image of a target object placed in a target imaging region from a first FOV and a second image of the target object from a second FOV;

analyzing the first image and the second image to identify at least a portion of a barcode associated with the target object in either the first image or the second image;

analyzing the first image and the second image to identify one or more features associated with the target object in each of the first image and the second image;

determine, with the trained object recognition model, a first target object identification for the target object based on the first image and a second target object identification for the target object based on the second image, wherein each of the first target object identification and the second target object identification is based on at least one of (i) the set of barcode data extracted from the at least the portion of the barcode, or (ii) the one or more features; and

responsive to determining that the first target object identification differs from the second target object identification, at least one of (i) generate a first alert for display to a user, (ii) generate a second alert for transmission to a remote monitoring system, or (iii) transmit a notification including the first target object identification and the second target object identification to a point-of-sale station.

10. The target object recognition method of claim 9 , further comprising:

responsive to determining that the target object identification probability exceeds the identification probability threshold, comparing the at least the portion of the barcode to a predicted barcode associated with a predicted product; and

responsive to determining a match between the at least the portion of the barcode and the predicted barcode, at least one of (i) identifying the target object as the predicted product and (ii) training the trained object recognition model using the at least the portion of the barcode and the predicted product.

11. The target object recognition method of claim 9 , wherein the second FOV has a relative orientation with respect to the first FOV, the at least the portion of the barcode has a barcode orientation within either the first image or the second image, and the method further comprising:

determining a target object identification probability for the target object based on (i) a set of barcode data extracted from the at least the portion of the barcode, (ii) the barcode orientation, (iii) the one or more features, and (iv) the relative orientation, wherein the target object identification probability associates the target object with a predicted product.

12. The target object recognition method of claim 9 , wherein the first FOV has a first central axis and the second FOV has a second central axis that is within 20 degrees of being substantially orthogonal to the first central axis.

13. The target object recognition method of claim 12 , wherein one of the first central axis or the second central axis extends in a substantially horizontal direction away from the barcode reader, and wherein one of the first central axis and the second central axis extends in a substantially vertical direction away from the barcode reader.

14. The target object recognition method of claim 9 , wherein the barcode reader has no other fields of view.

15. The target object recognition method of claim 9 , wherein the at least one imager comprises one imager, and the barcode reader has no other imagers configured to capture the first image and the second image.

16. The target object recognition method of claim 9 , wherein the one or more features includes at least one of (i) a graphic on the target object, (ii) an alphanumeric character on the target object, (iii) an edge of the target object, or (iv) a color of the target object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 1, 2024
From: BARKAN, EDWARD; DRZYMALA, MARK; HANDSHAW, DARRAN MICHAEL
To: ZEBRA TECHNOLOGIES CORPORATION
Reel/Frame 067287/0481 →
Continuity (2)
Continuation 16827000 · Mar 23, 2020
Related Publication 20240211712A1 · Jun 27, 2024
References Cited (8)
US 9892301B1 · Holub · 2018 [cited by examiner]
US 9892438B1 · Kundu · 2018 [cited by examiner]
US 11842487B2 · Jie · 2023 [cited by examiner]
US 20080231228A1 · Fowler · 2008 [cited by examiner]
US 20130278425A1 · Cunningham · 2013 [cited by examiner]
US 20140351098A1 · Shafer · 2014 [cited by examiner]
US 20160210492A1 · Trajkovic · 2016 [cited by examiner]
US 20200273013A1 · Garner · 2020 [cited by examiner]
Cited By (1)
US 12,718,221