IP Library Granted Patent US 11,647,286
Granted Patent B2
US 11,647,286 · App. 17/804,900 · Granted May 9, 2023

Systems, methods, and apparatuses for focus selection using image disparity

Inventors: Paul Poloniewicz (Charlotte, NC); Tao Xian (Mount Laurel, NJ); Chen Feng (Mount Laurel, NJ)
Assignee: HAND HELD PRODUCTS, INC.
H04N5/23212G06T7/50G06T7/70G06T9/00H04N5/2258H04N5/23218H04N5/23245
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,647,286
App. No.
17/804,900
Granted
May 9, 2023
Kind
B2
Abstract

Embodiments of the disclosure relate generally to automatic focus selection in a multi-imager environment. Embodiments include methods, systems, and apparatuses configured for capturing by a first image sensor, a first image of a visual object with a background associated with a subject. A characteristic difference between the visual object in the first image and the background in the first image is determined and a distance determination mode is selected based on the determined characteristic difference. Accordingly, a distance to the subject is calculated based on the selected distance determination mode and a second image sensor is controlled to capture a second image of the subject, based on the calculated distance to the subject.

Claims (61)

1. A method, comprising:

capturing, by a first image sensor, a first image of a visual object, wherein the first image is captured during at least a portion of a first illumination period, wherein a first illumination source is activated to illuminate a first field of view during the first illumination period;

calculating a distance to the subject based on a distance determination mode, wherein the distance determination mode is determined based on a characteristic difference between the visual object in the first image and a background in the first image; and

controlling a second image sensor to capture a second image of the subject based on the calculated distance to the subject, wherein the second image is captured during at least a portion of a second illumination period, wherein a second illumination source is configured to illuminate a second field of view during the second illumination period, and wherein the first illumination period is different from the second illumination period.

2. The method of claim 1 , further comprising determining the characteristic difference between the visual object in the first image and the background in the first image, wherein determining the characteristic difference comprises determining an intensity difference between a first intensity of the visual object in the first image and a second intensity of the background in the first image.

3. The method of claim 2 , further comprising selecting a distance determination mode from among a first mode and a second mode based on the characteristic difference, wherein selecting the distance determination mode comprises:

in response to the intensity difference being greater than or equal to a threshold, selecting the first mode as the distance determination mode; and

in response to the intensity difference being less than the threshold, selecting the second mode as the distance determination mode.

4. The method of claim 3 , wherein the first mode comprises calculating a depth of the visual object in the first image as the distance to the subject.

5. The method of claim 3 , wherein the second mode comprises:

determining a first location of the subject in the first image;

capturing by the second image sensor, a third image of the subject;

determining a second location of the subject in the third image; and

calculating the distance to the subject as a function of the first location and the second location.

6. The method of claim 5 , further comprising calculating the distance to the subject, based on imaging distances of the first image sensor and the second image sensor.

7. The method of claim 5 , wherein calculating the distance to the subject as a function of the first location and the second location comprises:

calculating a first image offset of the first image based on the first location;

calculating a second image offset of the third image based on the second location; and

calculating the distance to the subject based on the first image offset and the second image offset.

8. The method of claim 1 , further comprising changing a focus position of the second image sensor based on the calculated distance to the subject.

9. The method of claim 8 , further comprising:

capturing by the second image sensor, the second image of the subject from the changed focus position; and

decoding the second image to extract information encoded in the subject.

10. The method of claim 5 , wherein

the visual object is an aimer projection,

the subject comprises an information indicia,

the first image sensor comprises a near-field image sensor, and

the second image sensor comprises a far-field image sensor.

11. A system, comprising:

a memory configured to store executable instructions; and

one or more processors configured to execute the executable instructions to:

control a first illumination source to illuminate a first field of view for a first illumination period;

obtain, from a first image sensor during at least a portion of the first illumination period, a first image of a visual object with a background associated with a subject;

calculate a distance to the subject based on a distance determination mode, wherein the distance determination mode is determined based on a characteristic difference between the visual object in the first image and a background in the first image;

control a second illumination source to illuminate a second field of view for a second illumination period, wherein the second illumination period occurs after at least a portion of the first illumination period; and

control, based on the calculated distance to the subject, a second image sensor to capture a second image of the subject during at least a portion of the second illumination period.

12. The system of claim 11 , wherein the one or more processors are configured to determine the characteristic difference between the visual object in the first image and the background in the first image by determining an intensity difference between a first intensity of the visual object and a second intensity of the background.

13. The system of claim 12 , wherein the one or more processors are configured to select a distance determination mode from among a first mode and a second mode in response to the intensity difference being greater than or equal to a threshold, select the first mode as the distance determination mode; and in response to the intensity difference being less than the threshold, select the second mode as the distance determination mode.

14. The system of claim 13 , wherein the first mode comprises instructions to calculate a depth of the visual object in the first image as the distance to the subject.

15. The system of claim 13 , wherein the second mode comprises instructions to:

determine a first location of the subject in the first image;

obtain from a second image sensor, a third image of the subject;

determine a second location of the subject in the third image; and

calculate the distance to the subject as a function of the first location and the second location.

16. The system of claim 15 , wherein the one or more processors are further configured to calculate the distance of the subject, based on imaging distances of the first image sensor and the second image sensor.

17. The system of claim 15 , wherein to calculate the distance of the subject as a function of the first location and the second location, the one or more processors are configured to:

calculate a first image offset of the first image based on the first location;

calculate a second image offset of the third image based on the second location; and

calculate the distance of the subject based on the first image offset and the second image offset.

18. The system of claim 11 , wherein the one or more processors are further configured to change a focus position of the second image sensor based on the calculated distance to the subject.

19. The system of claim 18 , wherein the one or more processors are further configured to:

obtain from the second image sensor, the second image of the subject from the changed focus position; and

decode the third image to extract information encoded in the subject.

20. An imaging apparatus, comprising:

a first image sensor configured to capture a first image of a visual object with a background associated with a subject;

a second image sensor;

a first illumination source configured to illuminate a first field of view capturable by the first image sensor;

a second illumination source configured to illuminate a second field of view capturable by the second image sensor; and

a controller configured to:

obtain the first image from the first image sensor, wherein the first image is obtained in an instance in which a first illumination source is illuminated;

control the second image sensor to capture a second image of the subject based on a calculated distance, wherein the calculated distance is derived from a characteristic difference between the visual object in the first image and the background in the first image, wherein the second image is captured in an instance in which a second illumination source is activated.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 1, 2022
From: POLONIEWICZ, PAUL; XIAN, TAO; FENG, CHEN
To: HAND HELD PRODUCTS, INC.
Reel/Frame 060069/0366 →
Continuity (2)
Continuation 17145269 · Jan 8, 2021
Related Publication 20220303451A1 · Sep 22, 2022