IP Library Granted Patent US 10,025,379
Granted Patent B2
US 10,025,379 · App. 14/099,908 · Granted Jul 17, 2018

Eye tracking wearable devices and methods for use

Inventors: Eliot Francis Drake (Reno, NV); Gholamreza Amayeh (Reno, NV); Angelique Kano (Reno, NV); Dave Le Blanc (Reno, NV); Zhiming Liu (Reno, NV); Lewis James Marggraff (Reno, NV); Rory Pierce (Reno, NV); Nelson G. Publicover (Reno, NV); Christopher N. Spitler (Fernley, NV); Michael Vacchina (Reno, NV)
Assignee: Google LLC
G06F3/013A61B3/14G03B17/38G06F1/163G03B2213/025
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,025,379
App. No.
14/099,908
Granted
Jul 17, 2018
Kind
B2
Abstract

Devices and methods are provided for eye-tracking, e.g., including a freeform optical assembly and/or a modular design. In an exemplary embodiment, a device and method are provided that includes a wearable device on a user's head, the wearable device including a scene camera oriented to capture images of the user's surroundings. The user may perform a predetermined action with the user's eye to activate a photo feature of the wearable device, gaze at a region within the user's surroundings, the wearable device determining a focal point and limited field-of-view for the camera imaging field based on the center point, and activate the camera to capture an image of the limited field-of-view centered around the focal point.

Claims (29)

1. A method for taking a digital photo, comprising:

activating, at a wearable device comprising a scene camera oriented to capture images of a user's surroundings, a photo feature of the wearable device in response to a predetermined action by the user's eye, wherein the predetermined action comprises the user gazing at a Take Photo LED on the wearable device to activate a photo feature;

determining, by the wearable device, a focal point and limited field-of-view for an imaging field of the camera based on a center point of a region within the user's surroundings in response to the user gazing at the center point; and

capturing an image of the limited field-of-view centered around the focal point.

2. A method for taking a digital photo, comprising:

activating, at a wearable device comprising a scene camera oriented to capture images of a user's surroundings, a photo feature of the wearable device in response to the user gazing at a predetermined location of the wearable device;

determining, by the wearable device, in response to the user gazing at opposite corners of a virtual frame of a region within the user's surroundings, a focal point and limited field-of-view for an imaging field of the camera based on a center point and based upon the opposite corners; and

capturing an image of the limited field-of-view centered around the focal point.

3. The method of claim 2 , wherein activating a photo feature is in response to a user gazing at a Take Photo LED on the wearable device until the wearable device changes the LED to indicate the photo feature is active.

4. The method of claim 3 , wherein the LED changes color to indicate that the photo feature is active.

5. A device for taking a digital photo, comprising:

a wearable device configured to be worn on a user's head;

an endo-camera on the wearable device configured to obtain eye tracking images of the eye when the wearable device is worn by the user;

an exo-camera on the wearable device configured to obtain images of the user's surroundings when the wearable device is worn by the user; and

one or more processors coupled to the endo-camera configured to determine when the user performs a predetermined action with the user's eye to activate a photo feature of the wearable device, wherein the predetermined action comprises the user gazing at a Take Photo LED on the wearable device, the one or more processors coupled to the exo-camera configured to determine when the user gazes at a region within the user's surroundings in a predetermined manner, the one or more processors configured to determine a focal point and limited field-of-view for an imaging field of the exo-camera based on the predetermined manner, and to activate the exo-camera to capture an image of the limited field-of-view centered around the focal point.

6. The device of claim 5 , wherein the one or more processors are coupled to the Take Photo LED such that the one or more processors change a color of the LED to indicate the photo feature is active in response to the user gazing at the Take Photo LED.

7. A method for taking a digital photo, comprising:

activating, at a wearable device comprising a scene camera oriented to capture images of a user's surroundings, a photo feature in response to the user gazing at a predetermined location of the wearable device;

determining, by the wearable device, a focal point and limited field-of-view for an imaging field of the camera based on a center point of a region within the user's surroundings in response to the user gazing at the center point, wherein determining the limited field-of-view is further in response to the user gazing at opposite corners of a virtual frame; and

capturing an image of the limited field-of-view centered around the focal point.

8. The method of claim 7 , wherein activating the photo feature is in response to the user gazing at a Take Photo LED on the wearable device until the wearable device changes the LED to indicate the photo feature is active.

9. The method of claim 8 , wherein the LED changes color to indicate that the photo feature is active.

10. A device for taking a digital photo, comprising:

a wearable device configured to be worn on a user's head;

an eye tracking camera on the wearable device configured to obtain eye tracking images of the eye when the wearable device is worn by the user;

a scene camera on the wearable device configured to obtain images of the user's surroundings; and

one or more processors coupled to the eye tracking camera and the scene camera to determine when the user gazes at a predetermined location of the wearable device to activate a photo feature of the wearable device and when the user gazes at opposite corners of a virtual frame of a region within the user's surroundings, the one or more processors configured to determine a focal point and a limited field-of-view for an imaging field of the camera based on the gazed-upon opposite corners and to activate the scene camera to capture an image of the limited field-of-view centered around the focal point.

11. The device of claim 10 , wherein the predetermined location comprises a Take Photo LED.

12. The device of claim 11 , wherein the one or more processors are coupled to the Take Photo LED such that, when user gazes at the Take Photo LED, the one or more processors change a color of the LED to indicate the photo feature is active.

Assignments (3)
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2017
From: EYEFLUENCE, INC.
To: GOOGLE INC.
Reel/Frame 041579/0175 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2016
From: DRAKE, ELIOT FRANCIS; AMAYEH, GHOLAMREZA; KANO, ANGELIQUE; LEBLANC, DAVID; LIU, ZHIMING; MARGGRAFF, LEWIS JAMES; PIERCE, RORY; PUBLICOVER, NELSON GEORGE; SPITLER, CHRISTOPHER N.; VACCHINA, MICHAEL; WOOD, STEVEN B.
To: EYEFLUENCE, INC.
Reel/Frame 039774/0457 →
Continuity (4)
Provisional Application 61734354 · Dec 6, 2012
Provisional Application 61734294 · Dec 6, 2012
Provisional Application 61734342 · Dec 6, 2012
Related Publication 20140184775A1 · Jul 3, 2014
Cited By (77)
US 12,197,043 US 12,204,097 US 12,205,230 US 12,210,164 US 12,211,145 US 12,212,948 US 12,216,821 US 12,222,513 US 12,232,688 US 12,236,543 US 12,238,496 US 12,242,068 US 12,243,531 US 12,245,097 US 12,249,024 US 12,254,582 US 12,266,064 US 12,267,654 US 12,271,560 US 12,277,586 US 12,283,013 US 12,294,852 US 12,306,413 US 12,308,011 US 12,309,577 US 12,315,094 US 12,317,062 US 12,317,064 US 12,320,982 US 12,326,565 US 12,327,573 US 12,333,066 US 12,333,069 US 12,337,189 US 12,339,444 US 12,342,158 US 12,347,415 US 12,347,448 US 12,353,841 US 12,386,186 US 12,389,187 US 12,393,030 US 12,405,466 US 12,405,470 US 12,417,766 US 12,430,860 US 12,436,392 US 12,436,395 US 12,443,294 US 12,449,662 US 12,455,619 US 12,455,630 US 12,468,150 US 12,478,254 US 12,478,464 US 12,495,094 US 12,527,495 US 12,536,756 US 12,549,831 US 12,554,129 US 12,579,966 US 12,615,407 US 12,650,602 US 12,659,568 US 12,677,087 US 12,687,668 US 12,687,721 US 12,687,725 US 12,688,845 US 12,689,666 US 12,696,045 US 12,699,447 US 12,702,615 US 12,704,726 US 12,710,659 US 12,710,662 US 12,717,147