IP Library Granted Patent US 9,096,920
Granted Patent B1
US 9,096,920 · App. 13/427,583 · Granted Aug 4, 2015

User interface method

Inventors: Luis Ricardo Prada Gomez (Mountain View, CA); Alejandro Kauffmann (Mountain View, CA)
Assignee: Google Inc.
C23C4/06C23C4/065G06K9/00597H04N5/23219
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,096,920
App. No.
13/427,583
Granted
Aug 4, 2015
Kind
B1
Abstract

A computer-implemented method includes detecting, at a wearable computing device, a first direction of a first stare, wherein the wearable computing device includes a head-mountable display unit, identifying a target based on the detected first direction, and based on a determination that a first time duration of the first stare is greater than or equal to a first predetermined time threshold, identifying information relevant to the target and displaying the identified information on the display unit. Subsequent to displaying the identified information, the method includes detecting a second stare that is directed at the target or at the displayed information, and based on a determination that a second time duration of the second stare is greater than or equal to a second predetermined time threshold, identifying additional information relevant to the target, and displaying the additional information on the display unit.

Claims (56)

1. A computer-implemented method comprising:

detecting, at a wearable computing device, a first direction of a first stare, wherein the wearable computing device includes a head-mountable display unit;

identifying a target based on the detected first direction;

based on a determination that a first time duration of the first stare is greater than or equal to a first predetermined time threshold, identifying information relevant to the target and displaying the identified information on the head-mountable display unit;

subsequent to displaying the identified information, detecting a second stare that is directed at the target or at the displayed information, wherein the first stare and the second stare are contiguous in time; and

based on a determination that a second time duration of the second stare is greater than or equal to a second predetermined time threshold, identifying additional information relevant to the target, and displaying the additional information on the head-mountable display unit.

2. The method of claim 1 , wherein detecting the first direction of the first stare comprises:

obtaining at least one image of each eye of a wearer of the wearable computing device; and

determining the first stare direction from the at least one image of each eye.

3. The method of claim 2 , wherein obtaining the at least one image of each eye of the wearer of the wearable computing device comprises:

illuminating each eye with an infrared light source; and

imaging each eye with a camera.

4. The method of claim 1 , wherein identifying the target comprises:

capturing an image of the target; and

performing a target recognition based on the captured image.

5. The method of claim 1 , wherein the head mountable display unit comprises a see-through display unit.

6. The method of claim 1 , wherein the wearable computing device is a head-mounted device.

7. The method of claim 1 further comprising:

progressively displaying more additional information about the target while the stare continues.

8. A computer-implemented method comprising:

detecting, at a wearable computing device, a direction of a stare, wherein the wearable computing device includes a head-mountable display unit;

identifying a target based on the detected direction;

based on a determination that a first time duration of the stare is greater than or equal to a first predetermined time threshold, identifying information relevant to the target and displaying the identified information on the display unit;

subsequent to displaying the identified information, determining that a second time duration of the stare is greater than or equal to a second predetermined time threshold;

based on a determination that the second time duration of the stare is greater than or equal to the second predetermined time threshold, identifying additional information relevant to the target, and displaying the additional information on the display unit.

9. The method of claim 8 , wherein detecting the direction of the stare comprises:

obtaining at least one image of each eye of a wearer of the wearable computing device; and

determining the stare direction from the at least one image of each eye.

10. The method of claim 9 , wherein obtaining the at least one image of each eye of the wearer of the wearable computing device comprises:

illuminating each eye with an infrared light source; and

imaging each eye with a camera.

11. The method of claim 8 , wherein identifying the target comprises:

capturing an image of the target; and

performing a target recognition based on the captured image.

12. The method of claim 8 , wherein the head-mountable display unit comprises a see-through display unit.

13. The method of claim 8 further comprising:

progressively displaying more additional information about the target while the stare continues.

14. The method of claim 8 , wherein the wearable computing device is a head-mounted device.

15. A computer-implemented method comprising:

detecting, at a wearable computing device, a direction of a stare, wherein the wearable computing device includes a head-mountable display unit;

identifying a target based on the detected direction;

based on a determination that a first time duration of the stare is greater than or equal to a first predetermined time threshold, identifying information relevant to the target and displaying the identified information on the head-mountable display unit; and

subsequent to displaying the identified information, progressively displaying additional information about the target while the stare continues, comprising:

determining that a second time duration of the stare is greater than or equal to a second predetermined time threshold; and

based on a determination that the second time duration of the stare is greater than or equal to the second predetermined time threshold, identifying additional information relevant to the target, and displaying the additional information on the head-mountable display unit.

16. The method of claim 15 , wherein detecting the direction of the stare comprises:

obtaining at least one image of each eye of a wearer of the wearable computing device; and

determining the stare direction from the at least one image of each eye.

17. The method of claim 16 , wherein obtaining the at least one image of each eye of the wearer of the wearable computing device comprises:

illuminating each eye with an infrared light source; and

imaging each eye with a camera.

18. The method of claim 15 , wherein identifying the target comprises:

capturing an image of the target; and

performing a target recognition based on the captured image.

19. The method of claim 15 , wherein the head-mountable display unit comprises a see-through display unit.

20. The method of claim 15 , wherein the wearable computing device is a head-mounted device.

Assignments (2)
CHANGE OF NAME Recorded Oct 2, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044334/0466 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2012
From: GOMEZ, LUIS RICARDO PRADA; KAUFFMANN, ALEJANDRO
To: GOOGLE INC.
Reel/Frame 028752/0226 →