IP Library Granted Patent US 8,955,973
Granted Patent B2
US 8,955,973 · App. 13/631,594 · Granted Feb 17, 2015

Method and system for input detection using structured light projection

Inventors: Hayes Solos Raffle (Palo Alto, CA); Thad Eugene Starner (Mountain View, CA); Josh Weaver (San Jose, CA); Edward Allen Keyes (Mountain View, CA)
Assignee: Google Inc.
A61B3/113G01B11/167G01B11/2513A61F2009/00846G01B11/25G06F3/013
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,955,973
App. No.
13/631,594
Granted
Feb 17, 2015
Kind
B2
Abstract

Exemplary methods and systems help provide for tracking an eye. An exemplary method may involve: causing the projection of a pattern onto an eye, wherein the pattern comprises at least one line, and receiving data regarding deformation of the at least one line of the pattern. The method further includes correlating the data to iris, sclera, and pupil orientation to determine a position of the eye, and causing an item on a display to move in correlation with the eye position.

Claims (36)

1. A method comprising:

a light projector projecting a pattern of light onto an eye, wherein the pattern comprises at least one line;

receiving data regarding a first deformation of the at least one line of the pattern at a first time, wherein the first deformation of the at least one line comprises the line bowing outward when projected over the sclera or the line bowing inward when projected over the iris;

receiving data regarding a second deformation of the at least one line of the pattern at a second time that is subsequent to the first time, wherein the second deformation of the at least one line of the pattern comprises the line bowing outward relative to the first deformation of the at least one line or the line bowing inward relative to the first deformation of the at least one line; and

correlating the data to at least one of iris, sclera, and pupil orientation to determine a position of the eye.

2. A system comprising:

a non-transitory computer-readable medium; and

program instructions stored on the non-transitory computer-readable medium which, when executed by at least one processor, cause the system to:

cause a light projector to project a pattern of light onto an eye, wherein the pattern comprises at least one line;

receive data regarding a first deformation of the at least one line of the pattern at a first time, wherein the first deformation of the at least one line comprises the line bowing outward when projected over the sclera or the line bowing inward when projected over the iris;

receive data regarding a second deformation of the at least one line of the pattern at a second time that is subsequent to the first time, wherein the second deformation of the at least one line of the pattern comprises the line bowing outward relative to the first deformation of the at least one line or the line bowing inward relative to the first deformation of the at least one line;

correlate the data to iris, sclera, and pupil orientation to determine the position of the eye; and

cause an item on a display to move in correlation with the eye position.

3. A method comprising:

a light projector projecting a pattern of light onto an eye, wherein the pattern comprises at least one line;

receiving data regarding a first deformation of the at least one line of the pattern at a first time, wherein the first deformation of the at least one line comprises the line bowing outward when projected over the sclera or the line bowing inward when projected over the iris;

receiving data regarding a second deformation of the at least one line of the pattern at a second time that is subsequent to the first time, wherein the second deformation of the at least one line of the pattern comprises the line bowing outward relative to the first deformation of the at least one line or the line bowing inward relative to the first deformation of the at least one line;

correlating the data to iris, sclera, and pupil orientation, combined with eye dynamics, to determine a position of the eye; and

causing an item on a display to move in correlation with the position.

4. The method of claim 1 , wherein the pattern comprises a plurality of vertical and horizontal lines.

5. The method of claim 1 , wherein at least one line is not visible over the pupil.

6. The method of claim 1 , wherein correlating further comprises matching a deformed portion of the line that is bowed outward as being the portion of the line that is over the sclera.

7. The method of claim 1 , wherein correlating further comprises matching a deformed portion of the line that is bowed inward as being the portion of the line that is over the iris.

8. The method of claim 1 , further comprising monitoring eye movement with one or more cameras.

9. The method of claim 1 , further comprising causing an item on a display to move in correlation with the eye position.

10. The method of claim 1 , further comprising:

modeling glints caused by an ambient environment;

determining where the glints are relative to the eye;

predicting how the glints will change as the eye moves using data concerning the dynamics of the eye; and

combining the prediction with the correlation of the pattern and sclera, iris, and pupil data to track the eye.

11. The system of claim 2 , wherein the pattern comprises a plurality of vertical and horizontal lines.

12. The system of claim 2 , wherein the at least one line is not visible over the pupil.

13. The system of claim 2 , wherein correlating further comprises matching a deformed portion of the line that is bowed outward as being the portion of the line that is over the sclera.

14. The system of claim 2 , wherein correlating further comprises matching a deformed portion of the line that is bowed inward as being the portion of the line that is over the iris.

15. The system of claim 2 , wherein the system is a wearable computer and the display is a head-mounted display.

16. The system of claim 12 , wherein the system further provides a position and an orientation to the processor.

Assignments (2)
CHANGE OF NAME Recorded Oct 2, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044334/0466 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2012
From: RAFFLE, HAYES SOLOS; WEAVER, JOSH; KEYES, EDWARD; STARNER, THAD EUGENE
To: GOOGLE INC.
Reel/Frame 029541/0045 →
Continuity (2)
Provisional Application 61583685 · Jan 6, 2012
Related Publication 20130176533A1 · Jul 11, 2013