IP Library Granted Patent US 12,093,453
Granted Patent B2
US 12,093,453 · App. 18/304,303 · Granted Sep 17, 2024

Eye glint imaging in see-through computer display systems

Inventor: John N. Border (Campbell, CA)
Assignee: Mentor Acquisition One, LLC
G06F3/013G02B27/0093G02B27/017G02B27/0172G02B27/0189G06F1/163G06F1/1686G06F3/005G06T19/006G06V20/20G06V30/1423G06V40/19G09G5/003G09G5/10G02B2027/0118G02B2027/0127G02B2027/0138G02B2027/014G02B2027/0178G02B2027/0187G02C7/086G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,093,453
App. No.
18/304,303
Granted
Sep 17, 2024
Kind
B2
Abstract

Disclosure herein concerns a method that includes illuminating a user's eye with an illumination source in a head-worn display, capturing an image of the user's eye with an eye camera in the head-worn display, wherein the image includes an eye glint produced by light from the illumination source that is reflected from a surface of the user's eye, determining a size of an eye glint in the captured image, and identifying a change in focus distance for the user's eye in correspondence with a change in the size of the eye glint.

Claims (22)

1. A wearable head device comprising: a see-through display configured to present content to an eye of a user of the wearable head device, such that presenting the content to the eye produces an eye glint; one or more sensors; and one or more processors configured to perform a method comprising: capturing, via the one or more sensors, an image of the eye glint; determining, based on the image of the eye glint, a level of sharpness associated with the content; in accordance with a determination that the level of sharpness is below a threshold, increasing the level of sharpness; and in accordance with a determination that the level of sharpness is not below the threshold, forgoing increasing the level of sharpness; capturing, via the one or more sensors, an image of the iris of the eye; and determining a gaze location of the user based on the image of the eye glint and further based on the image of the iris; wherein increasing the level of sharpness is performed further in accordance with a determination of the gaze location relative to the see-through display.

2. The wearable device of claim 1 , further comprising a wearable device optic configured to provide the content to the see-through display, wherein increasing the level of sharpness comprises adjusting a focus of the wearable device optic.

3. The wearable device of claim 1 , wherein the see-through display comprises a first region corresponding to a central region of the see-through display and a second region corresponding to a peripheral region of the see-through display.

4. The wearable device of claim 3 , wherein the method further comprises determining whether the gaze location of the user is associated with the first region,

wherein increasing the level of sharpness is performed further in accordance with a determination that the gaze location is associated with the first region.

5. The wearable device of claim 3 , wherein the method further comprises determining whether the gaze location of a user is associated with the second region,

wherein forgoing increasing the level of sharpness is performed further in accordance with a determination that the gaze location is associated with the second region.

6. A method comprising: presenting, via a see-through display of a wearable head device, content to an eye of a user of the wearable head device, such that presenting the content to the eye produces an eye glint; capturing, via one or more sensors of the wearable head device, an image of the eye glint; determining, based on the image of the eye glint, a level of sharpness associated with the content; in accordance with a determination that the level of sharpness is below a threshold, increasing the level of sharpness; and in accordance with a determination that the level of sharpness is not below the threshold, forgoing increasing the level of sharpness; capturing, via the one or more sensors, an image of the iris of the eye; and determining a gaze location of the user based on the image of the eye glint and further based on the image of the iris;

wherein increasing the level of sharpness is performed further in accordance with a determination of the gaze location relative to the see-through display.

7. The method of claim 6 , wherein increasing the level of sharpness comprises adjusting a focus of a wearable device optic, the wearable device optic configured to provide the content to the see-through display.

8. The method of claim 6 , wherein the see-through display comprises a first region corresponding to a central region of the see-through display and a second region corresponding to a peripheral region of the see-through display.

9. The method of claim 8 , wherein the method further comprises determining whether the gaze location of the user is associated with the first region,

wherein increasing the level of sharpness is performed further in accordance with a determination that the gaze location is associated with the first region.

10. The method of claim 8 , wherein the method further comprises determining whether the gaze location of the user is associated with the second region,

wherein forgoing increasing the level of sharpness is performed further in accordance with a determination that the gaze location is associated with the second region.

11. A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method, comprising: presenting, via a see-through display of a wearable head device, content to an eye of a user of the wearable head device, such that presenting the content to the eye produces an eye glint; capturing, via one or more sensors of the wearable head device, an image of the eye glint; determining, based on the image of the eye glint, a level of sharpness associated with the content; in accordance with a determination that the level of sharpness is below a threshold, increasing the level of sharpness; and in accordance with a determination that the level of sharpness is not below the threshold, forgoing increasing the level of sharpness; capturing, via the one or more sensors, an image of the iris of the eye; and determining a gaze location of the user based on the image of the eye glint and further based on the image of the iris;

wherein increasing the level of sharpness is performed further in accordance with a determination of the gaze location relative to the see-through display.

12. The non-transitory computer-readable medium of claim 11 , wherein increasing the level of sharpness comprises adjusting a focus of a wearable device optic, the wearable device optic configured to provide the content to the see-through display.

13. The non-transitory computer-readable medium of claim 11 , wherein the see-through display comprises a first region corresponding to a central region of the see-through display and a second region corresponding to a peripheral region of the see-through display.

14. The non-transitory computer-readable medium of claim 13 , wherein the method further comprises determining whether the gaze location of the user is associated with the first region or the second region,

wherein increasing the level of sharpness is performed further in accordance with a determination that the view target is associated with the first region, and

wherein forgoing increasing the level of sharpness is performed further in accordance with a determination that the view target is associated with the second region.

Assignments (3)
SECURITY INTEREST Recorded Oct 29, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073430/0225 →
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0238 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 10, 2025
From: BORDER, JOHN N.
To: OSTERHOUT GROUP, INC.
Reel/Frame 072536/0608 →
Continuity (14)
Continuation 17737892 · May 5, 2022
Continuation 17339901 · Jun 4, 2021
Continuation 16776174 · Jan 29, 2020
Continuation 15815119 · Nov 16, 2017
Continuation 14884567 · Oct 15, 2015
Continuation In Part 14254253 · Apr 16, 2014
Continuation In Part 14218606 · Mar 18, 2014
Continuation In Part 14216175 · Mar 17, 2014
Continuation In Part 14181459 · Feb 14, 2014
Continuation In Part 14178047 · Feb 11, 2014
Continuation In Part 14712901 · Feb 4, 2014
Continuation In Part 14163646 · Jan 21, 2014
Continuation In Part 14160377 · Jan 24, 2014
Related Publication 20230273678A1 · Aug 31, 2023
Cited By (3)
US 12,333,069 US 12,537,682 US 12,585,118