IP Library › Granted Patent US 10,635,169
Granted Patent B2
US 10,635,169 · App. 15/983,772 · Granted Apr 28, 2020

Eye-tracking enabled wearable devices

Inventors: Simon Gustafsson (Danderyd, SE); Daniel Johansson Tornéus (Danderyd, SE); Jonas Andersson (Danderyd, SE); Johannes Kron (Danderyd, SE); Mårten Skogö (Danderyd, SE); Ralf Biedert (Danderyd, SE)
Assignee: Tobii AB
G06F3/013G02B27/0093G02B27/017G02B27/0179G06F3/012G06F3/0304G06F3/0485G06F3/04815G06F3/04845G06K9/00604G09G5/34A61B3/113G02B2027/014G02B2027/0138G02B2027/0187G06F2203/0381G09G2340/0464G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,635,169
App. No.
15/983,772
Granted
Apr 28, 2020
Kind
B2
Abstract

A system for determining a gaze direction of a user is disclosed. The system may include a first illuminator, a first profile sensor, and at least one processor. The first illuminator may be configured to illuminate an eye of a user. The first profile sensor may be configured to detect light reflected by the eye of the user. The processor(s) may be configured to determine a gaze direction of the user based at least in part on light detected by the first profile sensor.

Claims (36)

1. A system for determining a gaze direction of a user, wherein the system comprises:

a lens;

a display device configured to be viewed through the lens,

a hot mirror;

a first illuminator configured to illuminate an eye of a user;

an area image sensor arranged behind the display device and configured to detect light reflected by the eye of the user, wherein the area image sensor has a sensitive area having a total number of pixels characterized by a total number of rows and a total number of columns; and

at least one processor configured to determine the gaze direction of the user based at least in part on light detected by the area image sensor;

wherein determining the gaze direction of the user based at least in part on light detected by the area image sensor comprises:

determining a location of a glint on the eye caused by light reflected by the eye of the user, based at least in part on a higher magnitude light level detected at one or more pixels of the area image sensor;

wherein the step of determining the gaze direction of the user based at least in part on light detected by the area image sensor further comprises the steps of:

determining magnitudes of light exposure at a subset of the total number of rows during one or more illumination periods;

determining magnitudes of light exposure at a subset of the total number of columns during one or more illumination periods;

based on the magnitudes of light exposure at the subset of the total number of rows and the magnitudes of light exposure at the subset of the total number of columns, identifying a subset of a total number of pixels of the area image sensor which include and surround the one or more pixels of the area image sensor which detected the higher magnitude light level; and

analyzing only the subset of the total number of pixels of the area image sensor during a subsequent determination of gaze direction during a subsequent illumination period.

2. A system according to claim 1 , wherein the hot mirror is a coating or film arranged atop the lens.

3. A system according to claim 1 , wherein said the hot mirror is applied directly onto the lens.

4. A system according to claim 1 , wherein said hot mirror is in a form of a separate piece.

5. A system according to claim 1 , wherein the hot mirror is arranged on a side of the lens facing the user.

6. A system according to claim 1 , wherein an illuminator is arranged atop the hot mirror.

7. A system according to claim 1 , wherein the illuminator is arranged atop the hot mirror via a separate piece of material such as glass or plastic.

8. A method for determining a gaze direction of a user, wherein the method comprises:

displaying, through a lens, an image to the user by using a display device;

at least in part preventing, light in the infrared spectrum emitted by the display device,

from passing the lens by using a hot mirror illuminating an eye of a user;

detecting, with an area image sensor arranged behind the display device, light reflected

by the eye of the user, wherein the area image sensor has a sensitive area having a total

number of pixels characterized by a total number of rows and a total number of columns;

determining, with at least one processor, the gaze direction of the user based at least in part on light detected by the area image sensor;

wherein determining the gaze direction of the user based at least in part on light detected by the area image sensor comprises:

determining a location of a glint on the eye caused by light reflected by the eye of the user, based at least in part on a higher magnitude light level detected at one or more pixels of the area image sensor;

wherein the step of determining the location of the glint on the eye caused by light reflected by the eye of the user, based at least in part on the higher magnitude light level detected at one or more pixels of the area image sensor further comprises the steps of:

determining magnitudes of light exposure at a subset of the total number of rows during one or more illumination periods;

determining magnitudes of light exposure at a subset of the total number of columns during one or more illumination periods;

based on the magnitudes of light exposure at the subset of the total number of rows and the magnitudes of light exposure at the subset of the total number of columns, identifying a subset of a total number of pixels of the area image sensor which include and surround the one or more pixels of the area image sensor which detected the higher magnitude light level; and

analyzing only the subset of the total number of pixels of the area image sensor during a subsequent determination of gaze direction during a subsequent illumination period.

9. A non-transitory machine readable medium comprising a computer program adapted to perform the method according to claim 8 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2018
From: GUSTAFSSON, SIMON; TORNÉUS, DANIEL JOHANSSON; ANDERSSON, JONAS; KRON, JOHANNES; SKOGÖ, MÅRTEN; BIEDERT, RALF
To: TOBII AB
Reel/Frame 045846/0905 →
Continuity (4)
Continuation 15276448 · Sep 26, 2016
Provisional Application 62329719 · Apr 29, 2016
Provisional Application 62232268 · Sep 24, 2015
Related Publication 20180349698A1 · Dec 6, 2018
Cited By (1)
US 12,525,115