IP Library Granted Patent US 8,342,687
Granted Patent B2
US 8,342,687 · App. 12/893,128 · Granted Jan 1, 2013

Eye-tracking using a GPU

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,342,687
App. No.
12/893,128
Granted
Jan 1, 2013
Kind
B2
Abstract

Provided is a method of determining a gaze point of an eye watching a visual display controllable by a display signal. The method comprises generating a display signal using a graphics card in order for the visual display to produce a screen pattern; receiving a signal encoding an image of the eye including a corneo-scleral reflection of the screen pattern; and determining, based on in part the geometry of said reflection, a gaze point of the eye, wherein said determining a gaze point includes utilizing the graphics card as a parallel processor. The image of the eye may be received directly at the graphics card. The graphics card may extract image features in the eye images. Reference illuminators may be used, and the screen pattern may be interlaced with a distinctive reference pattern. Further provided are a gaze-tracking system and a personal computer system adapted to determine a gaze point of a viewer.

Claims (36)

1. A method of determining a gaze point of an eye watching a visual display controllable by a display signal, the method comprising:

generating a display signal using a graphics card in order for the visual display to produce a screen pattern;

receiving a signal encoding an image of the eye including a corneo-scleral reflection of the screen pattern; and

determining, based on in part the geometry of said corneo-scleral reflection of the screen pattern, a gaze point of the eye,

wherein said determining a gaze point includes utilizing the graphics card as a parallel processor,

wherein the graphics card receives, directly from the imaging device, the signal encoding an image of the eye including a corneo-scleral reflection of the screen pattern, and

wherein said determining a gaze point comprises:

extracting, using the graphics card, one or more image features in said corneo-scleral reflection of the screen pattern; and

comparing, using the graphics card, said one or more image features with the display signal in order to retrieve these in the screen pattern.

2. A method according to claim 1 , further comprising:

illuminating the eye by invisible light from at least one reference illuminator,

wherein:

the image of the eye further includes a glint produced by said at least one reference illuminator; and

said determining a gaze point is further based on the position of the glint.

3. A method according to claim 1 , wherein the image of the eye is received from an imaging device which is synchronized with the visual display and/or a reference illuminator.

4. A method according to claim 2 , wherein the image of the eye is received from an imaging device which is synchronized with the visual display and/or a reference illuminator.

5. A method according to claim 3 or 4 , further comprising:

repeatedly interlacing the screen pattern with a distinctive reference pattern.

6. A method according to claim 1 , wherein said receiving an image comprises decompressing a compressed image format.

7. A computer-readable medium containing instructions which when executed on a general-purpose computer perform the method of claim 1 .

8. A gaze tracking system, comprising:

a visual display controllable by a display signal;

an imaging device adapted to image the face of a viewer of the visual display; and

a graphics card adapted to generate a display signal for causing said visual display to produce a screen pattern,

said system characterized in a gaze-point determining module adapted to use the graphics card as a parallel processor to determine a gaze point of the viewer's eye based on in part the geometry of a corneo-scleral reflection of the screen pattern using an image of the viewer's eye containing said corneo-scleral reflection of the screen pattern, said image being received from the imaging device,

wherein the gaze-point determining module is operable to cause the graphics card to receive, directly from the imaging device, an image of the viewer's eye containing a cornea-scleral reflection of the screen pattern, and

wherein the graphics card is further adapted to:

extract image features in said corneo-scleral reflection of the screen pattern; and

compare said image features with the display signal in order to retrieve these in the screen pattern.

9. A gaze tracking system according to claim 8 , further comprising one or more reference illuminators, each being adapted to emit invisible light in order to produce a glint on a viewer's eye,

wherein the gaze tracking system is adapted to determine a gaze point of the viewer's eye further based on the position of the glint.

10. A gaze tracking system according to claim 9 , wherein said one or more reference illuminators are detachable.

11. A gaze tracking system according to claim 9 , wherein the imaging device is synchronized with the visual display and/or a reference illuminator.

12. A gaze tracking system according to claim 8 , wherein the imaging device is synchronized with the visual display and/or a reference illuminator.

13. A gaze tracking system according to claim 12 or 11 , wherein the graphics card is adapted to repeatedly interlace the screen pattern of the visual display with a distinctive reference pattern.

14. A personal computer system comprising a gaze tracking system according to claim 8 .

Assignments (2)
CHANGE OF NAME Recorded Jun 23, 2017
From: TOBII TECHNOLOGY AB
To: TOBII AB
Reel/Frame 042980/0766 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2010
From: BLIXT, PETER; KOBETSKI, MIROSLAV; HOGLUND, ANDERS
To: TOBII TECHNOLOGY AB
Reel/Frame 025059/0443 →