IP Library Granted Patent US 10,466,778
Granted Patent B2
US 10,466,778 · App. 15/408,197 · Granted Nov 5, 2019

Eye image selection

Inventor: Adrian Kaehler (Los Angeles, CA)
Assignee: Magic Leap, Inc.
G06F3/013G06F1/163G06F3/011G06K9/0061G06K9/00335G06K9/00604G06K9/00617G06K9/00926G06K9/036G06K9/52G06T1/20G06T3/4053G06T7/74G06T11/60G06T13/40G06T19/006G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,466,778
App. No.
15/408,197
Granted
Nov 5, 2019
Kind
B2
Abstract

Systems and methods for eye image set selection, eye image collection, and eye image combination are described. Embodiments of the systems and methods for eye image set selection can include comparing a determined image quality metric with an image quality threshold to identify an eye image passing an image quality threshold, and selecting, from a plurality of eye images, a set of eye images that passes the image quality threshold.

Claims (61)

1. A head mounted display system comprising:

an image capture device configured to capture a plurality of eye images of an eye;

a processor programmed to:

for each eye image of the plurality of eye images:

receive the eye image from the image capture device;

determine an image quality metric associated with the eye image; and

compare the determined image quality metric with an image quality threshold to determine whether the eye image passes the image quality threshold, wherein the image quality threshold corresponds to an image quality level for generating an iris code;

select, from the plurality of eye images, two eye images that pass the image quality threshold;

utilize both of the two selected eye images to generate a first iris code using a first iris code operation;

utilize both of the two selected eye images to generate a second iris code using a second iris code operation different from the first iris code operation;

determine a first confidence score based on the first iris code; and

determine a second confidence score based on the second iris code.

2. The head mounted display system of claim 1 , wherein to select the two eye images that pass the image quality threshold, the processor is programmed to buffer the selected eye images into a buffer of the processor.

3. The head mounted display system of claim 1 , wherein to select two eye images that pass the image quality threshold, the processor is programmed to utilize a polar coordinate representation of the two eye images.

4. The head mounted display system of claim 1 , wherein the first iris code operation comprises an image fusion operation and the second iris code operation comprises an iris fusion operation.

5. The head mounted display system of claim 1 , wherein the first iris code operation and the second iris code operation are performed in parallel or sequentially.

6. The head mounted display system of claim 4 , wherein the processor is further programmed to:

determining an eye pose of at least one of the two selected eye images; and

determine biometric data of an eye using the eye pose of at least one of the two selected eye images.

7. The head mounted display system of claim 1 , wherein to receive the eye image from the image capture device, the processor is programmed to receive the eye image from the image capture device during an eye image collection routine implemented by the processor.

8. The head mounted display system of claim 7 , wherein the eye image collection routine utilizes a graphic to obtain eye images.

9. The head mounted display system of claim 1 , wherein to select the two eye images that pass the image quality threshold, the processor is programmed to, for each of the two eye images:

buffer a first eye image of the plurality of eye images into a buffer;

determine that an image quality metric of a second eye image of the plurality of eye images passes an image quality metric of the first eye image; and

replace the first eye image with the second eye image in the buffer, wherein the second eye image corresponds to the selected eye image.

10. The head mounted display system of claim 1 , wherein the image quality metric corresponds to a blur image quality associated with a blur of the eye image, wherein the blur of the eye image corresponds to a degree of eye movement in the eye image relative to a reference eye image.

11. The head mounted display system of claim 1 , wherein the image quality metric corresponds to an amount of unoccluded pixels in the eye image.

12. The head mounted display system of claim 1 , wherein the image quality metric comprises a measure of at least one of: eye blink, glare, defocus, resolution, occluded pixels, unoccluded pixels, noise, artifacts, blur, or a combination thereof.

13. The head mounted display system of claim 1 , wherein the image quality metric comprises a weighted combination of a plurality of component quality metrics.

14. The head mounted display system of claim 1 , wherein the processor is further programmed to:

select the first iris code if the first confidence score exceeds the second confidence score; and

select the second iris code if the first confidence score does not exceed the second confidence score.

15. A method for processing an eye image, the method comprising:

under control of a processor:

obtaining a plurality of eye images;

for each eye image of the plurality of eye images,

determining an image quality metric associated with each eye image; and

comparing each determined image quality metric with an image quality threshold to determine whether the eye image passes the image quality threshold, wherein the image quality threshold corresponds to an image quality level for generating an iris code;

selecting, from the plurality of eye images, a non-empty set of eye images;

utilizing the set of eye images for generating a first iris code using a first iris code operation;

utilizing set of eye images for generating a second iris code using a second iris code operation different from the first iris code operation;

determining a first confidence score based on the first iris code; and

determining a second confidence score based on the second iris code.

16. The method of claim 15 , wherein selecting the non-empty set of eye images comprises:

identifying a percentage of eye images of the plurality of eye images that pass the image quality threshold to be selected.

17. The method of claim 15 , wherein selecting the non-empty set of eye images comprises:

identifying a total number of eye images to be selected; and

identifying the set of eye images, each having a determined image quality metric greater or equal to a determined image quality metric of an eye image not in the set.

18. The method of claim 15 , wherein each eye image in the non-empty set of eye images passes the image quality threshold.

19. The method of claim 15 , further comprising:

buffering the non-empty set of eye images and the corresponding determined image quality metrics in a data medium.

20. The method of claim 19 , further comprising:

obtaining an additional eye image that passes the image quality threshold;

selecting an eye image of the non-empty set of eye images buffered in the data medium;

determining that an image quality metric of the additional eye image passes an image quality metric of the eye image of the non-empty set of eye images buffered in the data medium; and

replacing, in the data medium, the selected eye image of the non-empty set of eye images buffered in the data medium and the image quality metric of the selected eye image of the non-empty set of eye images buffered in the data medium with the additional eye image and the image quality metric of the additional eye image respectively.

21. The method of claim 15 , wherein the image quality metric comprises a measure of at least one of: eye blink, glare, defocus, resolution, occluded pixels, unoccluded pixels, noise, artifacts, blur, or a combination thereof.

22. The method of claim 15 further comprising:

selecting the first iris code if the first confidence score exceeds the second confidence score; and

selecting the second iris code if the first confidence score does not exceed the second confidence score.

23. The method of claim 15 wherein the first iris code operation comprises an image fusion operation and the second iris code operation comprises an iris fusion operation.

Assignments (3)
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →
PROPRIETARY INFORMATION AND INVENTIONS AGREEMENT Recorded Jun 26, 2018
From: KAEHLER, ADRIAN
To: MAGIC LEAP, INC.
Reel/Frame 046428/0138 →
Continuity (4)
Provisional Application 62280456 · Jan 19, 2016
Provisional Application 62280515 · Jan 19, 2016
Provisional Application 62280437 · Jan 19, 2016
Related Publication 20170206412A1 · Jul 20, 2017