IP Library › Patent Application 14291254
Patent Application
App. No. 14/291,254

GAZE TRACKING FOR ONE OR MORE USERS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
14/291,254
Abstract

One or more techniques and/or systems are provided for gaze tracking of one or more users. A user tracking component (e.g., a depth camera or a relatively lower resolution camera) may be utilized to obtain user tracking data for a user. The user tracking data is evaluated to identify a spatial location of the user. An eye capture camera (e.g., a relatively higher resolution camera) may be selected from an eye capture camera configuration based upon the eye capture camera having a view frustum corresponding to the spatial location of the user. The eye capture camera may be invoked to obtain eye region imagery of the user. Other eye capture cameras within the eye capture camera configuration are maintained in a powered down state to reduce power and/or bandwidth consumption. Gaze tracking information may be generated based upon the eye region imagery, and may be used to perform a task.

Claims (77)

1 . A system for gaze tracking, comprising:

a gaze tracking component configured to:

utilize a user tracking component to obtain first user tracking data for a first user at a first time T 1 ;

evaluate the first user tracking data to identify a first spatial location of the first user at the first time T 1 ;

select a first eye capture camera from an eye capture camera configuration based upon the first eye capture camera having a first view frustum corresponding to the first spatial location, the eye capture camera configuration comprising a plurality of eye capture cameras having a fixed view frustum configuration;

invoke the first eye capture camera to obtain first eye region imagery of the first user at the first time T 1 ; and

generate first gaze tracking information for the first user at the first time T 1 based upon the first eye region imagery.

2 . The system of claim 1 , the gaze tracking component configured to:

perform a task based upon the first gaze tracking information.

3 . The system of claim 1 , the gaze tracking component configured to:

predict a potential new spatial location of the first user; and

responsive to the potential new spatial location corresponding to a second view frustum for eye capture camera, awaken the second eye capture camera into a capture ready state for obtaining eye region imagery.

4 . The system of claim 1 , the gaze tracking component configured to:

maintain one or more eye capture cameras of the eye capture camera configuration in a powered down state at the first time T 1 based upon the one or more eye capture cameras having view frustums not corresponding to the first spatial location.

5 . The system of claim 1 , the gaze tracking component configured to:

responsive to the first user tracking data indicating that the first user is, at a second time T 2 , within a second spatial location to which the first view frustum does not correspond, transition the first eye capture camera into a powered down state at the second time T 2 .

6 . The system of claim 1 , the gaze tracking component configured to:

select a second eye capture camera from the eye capture camera configuration based upon the second eye capture camera having a second view frustum corresponding to the first spatial location;

invoke the second eye capture camera to obtain second eye region imagery of the first user at the first time T 1 ; and

combine the first eye region imagery and the second eye region imagery to generate the first gaze tracking information.

7 . The system of claim 1 , the gaze tracking component configured to:

responsive to the first user tracking data indicating that the first user is, at a second time T 2 , within a second spatial location:

select a second eye capture camera from the eye capture camera configuration based upon the second eye capture camera having a second view frustum corresponding to the second spatial location;

transition, at the second time T 2 , the first eye capture camera into a powered down state based upon the first view frustum not corresponding to the second spatial location;

invoke the second eye capture camera to obtain second eye region imagery of the first user at the second time T 2 ; and

generate second gaze tracking information for the first user at the second time T 2 based upon the second eye region imagery.

8 . The system of claim 1 , the gaze tracking component configured to:

utilize the user tracking component to obtain second user tracking data for a second user at the first time T 1 ;

evaluate the second user tracking data to identify a second spatial location of the second user at the first time T 1 ;

select a second eye capture camera from the eye capture camera configuration based upon the second eye capture camera having a second view frustum corresponding to the second spatial location;

invoke the second eye capture camera to obtain second eye region imagery of the second user at the first time T 1 ; and

generate second gaze tracking information for the second user at the first time T 1 based upon the second eye region imagery.

9 . The system of claim 8 , the gaze tracking component configured to:

concurrently track the first gaze tracking information for the first user and the second gaze tracking information for the second user.

10 . The system of claim 1 , first eye capture camera having a first resolution that is greater than a second resolution of the user tracking component.

11 . The system of claim 1 , the gaze tracking component configured to:

selectively utilize eye capture cameras of the eye capture camera configuration to concurrently track gaze tracking information of one or more users.

12 . The system of claim 1 , the gaze tracking component configured to:

turn on a pupil illumination structure of the first eye capture camera to invoke the first eye capture camera to obtain the first eye region imagery.

13 . The system of claim 1 , the gaze tracking component configured to:

turn on an LED dark pupil structure; and

invoke the first eye capture camera to capture glint corneal reflection data resulting from the LED dark pupil structure to obtain the first eye region imagery.

14 . The system of claim 1 , the user tracking component comprising at least one of a depth camera, a passive sensor, an active sensor, an infrared device, a time of flight device, or a camera.

15 . The system of claim 1 , at least one of the eye capture cameras of the eye capture camera configuration having a horizontal view of about 20 degrees to about 40 degrees and a vertical view of about 10 degrees to about 30 degrees frustum.

16 . A method for gaze tracking, comprising:

utilizing a user tracking component to obtain first user tracking data for a first user at a first time T 1 ;

evaluating the first user tracking data to identify a first spatial location of the first user at the first time T 1 ;

selecting a first eye capture camera from an eye capture camera configuration based upon the first eye capture camera having a first view frustum corresponding to the first spatial location, the eye capture camera configuration comprising a plurality of eye capture cameras having a fixed view frustum configuration;

invoking the first eye capture camera to obtain first eye region imagery of the first user at the first time T 1 ; and

generating first gaze tracking information for the first user at the first time T 1 based upon the first eye region imagery.

17 . The method of claim 16 , comprising:

maintaining one or more eye capture cameras of the eye capture camera configuration in a powered down state at the first time T 1 based upon the one or more eye capture cameras having view frustums not corresponding to the first spatial location.

18 . The method of claim 16 , comprising:

responsive to the first user tracking data indicating that the first user is, at a second time T 2 , within a second spatial location:

selecting a second eye capture camera from the eye capture camera configuration based upon the second eye capture camera having a second view frustum corresponding to the second spatial location;

transitioning, at the second time T 2 , the first eye capture camera into a powered down state based upon the first view frustum not corresponding to the second spatial location;

invoking the second eye capture camera to obtain second eye region imagery of the first user at the second time T 2 ; and

generating second gaze tracking information for the first user at the second time T 2 based upon the second eye region imagery.

19 . The method of claim 16 , comprising:

utilizing the user tracking component to obtain second user tracking data for a second user at the first time T 1 ;

evaluating the second user tracking data to identify a second spatial location of the second user at the first time T 1 ;

selecting a second eye capture camera from the eye capture camera configuration based upon the second eye capture camera having a second view frustum corresponding to the second spatial location;

invoking the second eye capture camera to obtain second eye region imagery of the second user at the first time T 1 ; and

generating second gaze tracking information for the second user at the first time T 1 based upon the second eye region imagery.

20 . A computer readable medium comprising instructions which when executed perform a method for concurrently tracking gaze tracking information for multiple users, comprising:

tracking a first user, comprising:

utilizing a user tracking component to obtain first user tracking data for the first user at a first time T 1 ;

evaluating the first user tracking data to identify a first spatial location of the first user at the first time T 1 ;

selecting a first eye capture camera from an eye capture camera configuration based upon the first eye capture camera having a first view frustum corresponding to the first spatial location, the eye capture camera configuration comprising a plurality of eye capture cameras;

invoking the first eye capture camera to obtain first eye region imagery of the first user at the first time T 1 ; and

generating first gaze tracking information for the first user at the first time T 1 based upon the first eye region imagery; and

concurrently tracking a second user while tracking the first user, comprising:

utilizing the user tracking component to obtain second user tracking data for the second user at the first time T 1 ;

evaluating the second user tracking data to identify a second spatial location of the second user at the first time T 1 ;

selecting a second eye capture camera from the eye capture camera configuration based upon the second eye capture camera having a second view frustum corresponding to the second spatial location;

invoking the second eye capture camera to obtain second eye region imagery of the second user at the first time T 1 ; and

generating second gaze tracking information for the second user at the first time T 1 based upon the second eye region imagery.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2015
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 036962/0358 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 30, 2015
From: THUKRAL, VAIBHAV; EDEN, IBRAHIM; SWAMINATHAN, SHIVKUMAR; NISTER, DAVID; VENABLE, MORGAN
To: MICROSOFT CORPORATION
Reel/Frame 036922/0317 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2015
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 039025/0454 →