IP Library › Granted Patent US 11,490,030
Granted Patent B2
US 11,490,030 · App. 17/446,773 · Granted Nov 1, 2022

Apparatuses, computer-implemented methods, and computer program products for flicker reduction in a multi-sensor environment

Inventors: Benjamin Hejl (Cherry Hill, NJ); Ka Man Au (Philadelphia, PA); Erik Van Horn (Seaville, NJ); David M. Wilz (Sewell, NJ); Michael V. Miraglia (Hamilton, NJ); Patrick Giordano (Glassboro, NJ)
Assignee: Hand Held Products, Inc.
H04N5/2357G06K7/1095G06K7/10881
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,490,030
App. No.
17/446,773
Granted
Nov 1, 2022
Kind
B2
Abstract

Embodiments of the disclosure relate generally to flicker reduction in a multi-imager environment. Embodiments include methods, computer program products, and apparatuses configured for producing a near-field illumination using a near-field illuminator, the near-field illumination produced at a defined pulse train. A near-field image sensor may be exposed near the start of a near-field illumination pulse, and a far-field image sensor may be exposed between pulses of the near-field illumination. Some embodiments, additionally or alternatively, are configured for detecting an illuminator switch event, deactivating the near-field illuminator source, and producing, using a far-field illuminator source, a far-field illumination. Upon switching the illuminator source, some such embodiments are configured for exposing a far-field illuminator near the start of the far-field illumination pulse, and exposing a near-field image sensor near the start of the next available far-field illumination pulse. Such image capture may repeat until an image processing task such as barcode reading is successful.

Claims (90)

1. A method for flicker reduction in a multi-imager environment, the method comprising:

(a) producing, using a first illuminator source of a plurality of illuminator sources, a first illumination, wherein the plurality of illuminator sources comprises more than two illuminator sources;

(b) exposing a near-field image sensor during the first illumination;

(c) generating a first near-field image based on the exposure of the near-field image sensor;

(d) exposing a far-field image sensor such that the exposure of the far-field image sensor is not during any pulse associated with the first illumination;

(e) generating a first far-field image based on the exposure of the far-field image sensor;

(f) repeating steps (b)-(e) until a first illumination switch event is detected;

(g) detecting a first illuminator switch event;

in response to the detection of the first illuminator switch event:

(h) deactivating the first illuminator source;

(i) producing, using a second illuminator source of the plurality of illuminator sources, a second illumination associated with at least one second illumination pulse, wherein a second field of view illuminated by the second illuminator source is different than a first field of view illuminated by the first illuminator source;

(j) exposing the near-field image sensor during the second illumination;

(k) generating a second near-field image based on the exposure of the near-field image sensor during the second illumination;

(l) exposing the far-field image sensor such that the exposure of the far-field image sensor is not during any pulse associated with the second illumination;

(m) generating the far-field image based on the exposure of the far-field image sensor during the second illumination; and

(n) repeating steps (j)-(m) for the second illuminator source until a second illuminator switch event is detected.

2. The method of claim 1 , wherein the field of view illuminated by the second illuminator source is narrower than the field of view illuminated by the first illuminator source.

3. The method of claim 1 , the method further comprising:

(o) detecting the second illuminator switch event, in response to the detection of the second illuminator switch event:

(p) deactivating the second illuminator source;

(q) producing, using a third illuminator source of the plurality of illuminator sources, a third illumination associated with at least one third illumination pulse, wherein a field of view illuminated by the third illuminator source is narrower than the field of view illuminated by the first illuminator source;

(r) exposing the near-field image sensor during the third illumination;

(s) generating a third near-field image based on the exposure of the near-field image sensor during the third illumination;

(t) exposing the far-field image sensor such that the exposure of the far-field image sensor is not during any pulse associated with the third illumination;

(u) generating the far-field image based on the exposure of the far-field image sensor during the third illumination; and

(v) repeating steps (r)-(u) for the third illuminator source till a third illuminator switch event is detected.

4. The method of claim 1 , wherein whenever a subsequent illuminator switch event is detected, steps (h)-(n) are repeated corresponding to a subsequent illumination associated with a subsequent illuminator source of the plurality of illuminator sources, the subsequent illumination illuminating a subsequent field of view wherein the subsequent field of view illuminated by the subsequent illuminator source is narrower than the field of view illuminated by a previous illuminator source, and wherein a first effective range provided by the subsequent illuminator is greater than a second effective range provided by the previous illuminator source.

5. The method of claim 1 , the method further comprising, prior to exposing the near-field image sensor during the first illumination:

determining that the near-field image sensor was last utilized for capturing an image that was successfully processed.

6. The method of claim 1 , wherein a first pulse associated with the first illumination is produced at a same rate and for a same length as a second pulse associated with the second illumination.

7. The method of claim 1 , wherein each illuminator source of the plurality of illuminator sources is configured to produce illumination pulses based on a respective defined pulse frequency and a respective defined pulse phase.

8. The method of claim 1 , wherein detecting the first illuminator switch event comprises:

determining each captured image of a captured image set is associated with an image property that does not satisfy an image property threshold, wherein the captured image set comprises at least the near-field image and the far-field image,

wherein the captured image set comprises a number of captured images, wherein the number of captured images satisfies a near-illuminator capture threshold, and wherein the image property comprises an image white level value, and wherein the image property threshold comprises a minimum white level threshold.

9. The method of claim 1 , wherein the near-field imaging sensor is utilized to capture a plurality of near-field images prior to exposing the far-field image sensor.

10. The method of claim 1 , wherein a beginning of the exposure of the far-field image sensor is near-aligned with a first pulse end time of a first pulse associated with the first illumination.

11. The method of claim 1 , the method further comprising:

processing the first far-field image to determine an image property associated with the far-field image does not satisfy an image property threshold associated with the image property; and

altering at least one of an exposure time value for the far-field image sensor or a gain value for the far-field image sensor.

12. An apparatus for flicker reduction in a multi-imager environment, the apparatus comprising:

a multi-sensor imaging engine comprising a plurality of illuminator sources, a near-field image sensor, and a far-field image sensor; and

a processor that configures the apparatus to:

(a) produce, using a first illuminator source of the plurality of illuminator sources, a first illumination, wherein the plurality of illuminator sources comprises more than two illuminator sources;

(b) expose the near-field image sensor during the first illumination;

(c) generate a first near-field image based on the exposure of the near-field image sensor;

(d) expose the far-field image sensor such that the exposure of the far-field image sensor is not during any pulse associated with the first illumination;

(e) generate a first far-field image based on the exposure of the far-field image sensor;

(f) repeat steps (b)-(e) until a first illumination switch event is detected;

(g) detect a first illuminator switch event;

in response to the detection of the first illuminator switch event:

(h) deactivate the first illuminator source;

(i) produce, using a second illuminator source of the plurality of illuminator sources, a second illumination associated with at least one second illumination pulse, wherein a second field of view illuminated by the second illuminator source is different than a first field of view illuminated by the first illuminator source;

(j) expose the near-field image sensor during the second illumination;

(k) generate a second near-field image based on the exposure of the near-field image sensor during the second illumination;

(l) expose the far-field image sensor such that the exposure of the far-field image sensor is not during any pulse associated with the second illumination;

(m) generate the far-field image based on the exposure of the far-field image sensor during the second illumination; and

(n) repeat steps (j)-(m) for the second illuminator source until a second illuminator switch event is detected.

13. The apparatus of claim 12 , wherein the field of view illuminated by the second illuminator source is narrower than the field of view illuminated by the first illuminator source.

14. The apparatus of claim 12 , wherein the apparatus is further configured to:

(o) detect the second illuminator switch event,

in response to the detection of the second illuminator switch event:

(p) deactivate the second illuminator source;

(q) produce, using a third illuminator source of the plurality of illuminator sources, a third illumination associated with at least one third illumination pulse, wherein a field of view illuminated by the third illuminator source is narrower than the field of view illuminated by the first illuminator source;

(r) expose the near-field image sensor during the third illumination;

(s) generate a third near-field image based on the exposure of the near-field image sensor during the third illumination;

(t) expose the far-field image sensor such that the exposure of the far-field image sensor is not during any pulse associated with the third illumination;

(u) generate the far-field image based on the exposure of the far-field image sensor during the third illumination; and

(v) repeat steps (r)-(u) for the third illuminator source until a third illuminator switch event is detected.

15. The apparatus of claim 12 , wherein whenever a subsequent illuminator switch event is detected, steps (h)-(n) are repeated corresponding to a subsequent illumination associated with a subsequent illuminator source of the plurality of illuminator sources, the subsequent illumination illuminating a subsequent field of view wherein the subsequent field of view illuminated by the subsequent illuminator source is narrower than the field of view illuminated by a previous illuminator source, and wherein a first effective range provided by the subsequent illuminator is greater than a second effective range provided by the previous illuminator source.

16. The apparatus of claim 12 , the apparatus further configured to, prior to exposing the near-field image sensor during the first illumination:

determine that the near-field image sensor was last utilized for capturing an image that was successfully processed.

17. The apparatus of claim 12 , wherein a first pulse associated with the first illumination is produced at a same rate and for a same length as a second pulse associated with the second illumination.

18. The apparatus of claim 12 , wherein each illuminator source of the plurality of illuminator sources is configured to produce illumination pulses based on a respective defined pulse frequency and a respective defined pulse phase.

19. A computer program product for flicker reduction in a multi-imager environment, the computer program product comprising at least one non-transitory computer-readable storage medium having computer program code stored thereon, the computer program code, in execution with at least one processor, configured for:

(a) producing, using a first illuminator source of a plurality of illuminator sources, a first illumination, wherein the plurality of illuminator sources comprises more than two illuminator sources;

(b) exposing a near-field image sensor during the first illumination;

(c) generating a first near-field image based on the exposure of the near-field image sensor;

(d) exposing a far-field image sensor such that the exposure of the far-field image sensor is not during any pulse associated with the first illumination;

(e) generating a first far-field image based on the exposure of the far-field image sensor;

(f) repeating steps (b)-(e) until a first illumination switch event is detected;

(g) detecting a first illuminator switch event;

in response to the detection of the first illuminator switch event:

(h) deactivating the first illuminator source;

(i) producing, using a second illuminator source of the plurality of illuminator sources, a second illumination associated with at least one second illumination pulse, wherein a second field of view illuminated by the second illuminator source is different than a first field of view illuminated by the first illuminator source;

(j) exposing the near-field image sensor during the second illumination;

(k) generating a second near-field image based on the exposure of the near-field image sensor during the second illumination;

(l) exposing the far-field image sensor such that the exposure of the far-field image sensor is not during any pulse associated with the second illumination;

(m) generating the far-field image based on the exposure of the far-field image sensor during the second illumination; and

(n) repeating steps (j)-(m) for the second illuminator source till a second illuminator switch event is detected.

20. The computer program product of claim 19 , wherein whenever a subsequent illuminator switch event is detected, steps (h)-(n) are repeated corresponding to a subsequent illumination associated with a subsequent illuminator source of the plurality of illuminator sources, the subsequent illumination illuminating a subsequent field of view wherein the subsequent field of view illuminated by the subsequent illuminator source is narrower than the field of view illuminated by a previous illuminator source, and wherein a first effective range provided by the subsequent illuminator is greater than a second effective range provided by the previous illuminator source.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2021
From: HEJL, BENJAMIN; AU, KA MAN; VAN HORN, ERIK; WILZ, DAVID M.; MIRAGLIA, MICHAEL V.; GIORDANO, PATRICK
To: HAND HELD PRODUCTS, INC.
Reel/Frame 057373/0162 →
Continuity (2)
Continuation 16805497 · Feb 28, 2020
Related Publication 20210400183A1 · Dec 23, 2021