IP Library Granted Patent US 11,237,631
Granted Patent B2
US 11,237,631 · App. 17/168,006 · Granted Feb 1, 2022

Method and system for eye tracking using speckle patterns

Inventors: Asif Sinay (Tel-Aviv, IL); Barak Freedman (Binyamina, IL); Evyatar Bluzer (Yuvalim, IL)
Assignee: Magic Leap, Inc.
G06F3/013G01N21/4788G02B27/0093G02B27/0172G06T7/20G06T7/262G06T7/32H04N5/232H04N5/23245G01N2021/479G02B2027/0138G06T2207/10048G06T2207/30041
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,237,631
App. No.
17/168,006
Granted
Feb 1, 2022
Kind
B2
Abstract

A method of tracking an eye gaze include obtaining a pre-calibrated speckle map of the eye of the user, determining a starting position of the eye using the pre-calibrated speckle map, and tracking movement of the eye relative to the starting position by: directing a light beam at the eye, detecting a plurality of speckle patterns formed at a detector by a portion of the light beam reflected by the eye, and tracking movement of the eye relative to the starting position by tracking the plurality of speckle patterns from frame to frame.

Claims (30)

1. A method of tracking a gaze of an eye of a user, the method comprising:

obtaining a pre-calibrated speckle map of the eye of the user by:

directing a first light beam at the eye, the eye reflecting a portion of the first light beam;

detecting a plurality of first speckle patterns formed at a detector by the portion of the first light beam reflected by the eye, each of the plurality of first speckle patterns corresponding to a respective first position of the eye;

recording a plurality of images of the eye using a camera, each of the plurality of images of the eye being recorded when a respective first speckle pattern is detected;

determining the respective first position of the eye corresponding to each respective first speckle pattern based on the respective image of the eye; and

storing the plurality of first speckle patterns and the corresponding first positions of the eye;

determining a starting position of the eye using the pre-calibrated speckle map by:

directing a second light beam at the eye, the eye reflecting a portion of the second light beam;

detecting a plurality of second speckle patterns formed at the detector by the portion of the second light beam reflected by the eye; and

determining the starting position of the eye based on comparisons between the plurality of second speckle patterns and the stored plurality of first speckle patterns and the stored corresponding first positions of the eye; and

tracking movement of the eye relative to the starting position by:

directing a third light beam at the eye, the eye reflecting a portion of the third light beam;

detecting a plurality of third speckle patterns formed at the detector by the portion of the third light beam reflected by the eye, the plurality of third speckle patterns being detected at a predetermined frame rate; and

tracking movement of the eye relative to the starting position by tracking the third plurality of speckle patterns from frame to frame.

2. The method of claim 1 wherein each of the portion of the first light beam reflected by the eye, the portion of the second light beam reflected by the eye, and the portion of the third light beam reflected by the eye is diffusely reflected or specular reflected by the eye.

3. The method of claim 1 wherein tracking the third plurality of speckle patterns is performed using an optical flow algorithm.

4. The method of claim 3 wherein the optical flow algorithm comprises a phase correlation algorithm.

5. The method of claim 1 wherein the predetermined frame rate is greater than about 50 frames per second and less than about 15,000 frames per second.

6. The method of claim 1 further comprising:

determining that the eye has blinked;

determining a new starting position of the eye by:

directing a fourth light beam at the eye, the eye reflecting a portion of the fourth light beam;

detecting a plurality of fourth speckle patterns formed at the detector by the portion of the fourth light beam reflected by the eye; and

determining the new starting position of the eye based on comparisons between the plurality of fourth speckle patterns and the stored plurality of first speckle patterns and the stored corresponding first positions of the eye; and

tracking movement of the eye relative to the new starting position by:

directing a fifth light beam at the eye, the eye reflecting a portion of the fifth light beam;

detecting a plurality of fifth speckle patterns formed at the detector by the portion of the fifth light beam reflected by the eye, the plurality of fifth speckle patterns being detected at the predetermined frame rate; and

tracking movement of the eye relative to the new starting position by tracking the fifth plurality of speckle patterns from frame to frame.

7. The method of claim 1 wherein each of the first light beam, the second light beam, and the third light beam comprises infrared radiation.

Assignments (2)
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2021
From: SINAY, ASIF; FREEDMAN, BARAK; BLUZER, EVYATAR
To: MAGIC LEAP, INC.
Reel/Frame 055962/0252 →
Continuity (3)
Division 15805635 · Nov 7, 2017
Provisional Application 62420292 · Nov 10, 2016
Related Publication 20210232221A1 · Jul 29, 2021