IP Library › Granted Patent US 10,852,531
Granted Patent B2
US 10,852,531 · App. 16/449,828 · Granted Dec 1, 2020

Determining eye openness with an eye tracking device

Inventors: Mark Ryan (Danderyd, SE); Torbjörn Sundberg (Danderyd, SE); Pravin Rana (Danderyd, SE); Yimu Wang (Danderyd, SE)
Assignee: Tobii AB
G02B26/0875A61B3/112A61B3/113A61B5/1079A61B5/1103A61B5/163A61B5/6803G02B27/0093G06F3/013G06K9/00597G06K9/00604G06T7/70G06T7/73G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,852,531
App. No.
16/449,828
Granted
Dec 1, 2020
Kind
B2
Abstract

A method for determining eye openness with an eye tracking device is disclosed. The method may include determining, for pixels of an image sensor of an eye tracking device, during a first time period when an eye of a user is open, a first sum of intensity of the pixels. The method may also include determining, during a second time period when the eye of the user is closed, a second sum of intensity of the pixels. The method may further include determining, during a third time period, a third sum of intensity of the pixels. The method may additionally include determining that upon the third sum exceeding a fourth sum of the first sum plus a threshold amount, that the eye of the user is closed, the threshold amount is equal to a product of a threshold fraction and a difference between the first sum and the second sum.

Claims (35)

1. A method for determining eye openness with an eye tracking device, wherein the method comprises:

receiving, at one or more processors, an image of an eye of a user from an image sensor of an eye tracking device;

determining, with the one or more processors, based on the image of the eye, a radius of the pupil;

determining, with the one or more processors, based on the radius of the pupil, a total area of the pupil;

determining, with the one or more processors, based on the image of the eye and the radius of the pupil, an amount of the total area of the pupil which is not obscured by either eyelid; and

determining, with the one or more processors, based on the amount of the total area of the pupil which is not obscured by the eyelid and the total area of the pupil, whether the eye of the user is closed.

2. The method for determining eye openness with an eye tracking device of claim 1 , wherein:

when the total area of the pupil which is not obscured is greater than a remainder of the pupil, the eye of the user is open.

3. The method for determining eye openness with an eye tracking device of claim 1 , wherein:

when the total area of the pupil which is not obscured is less than a remainder of the pupil, the eye of the user is closed.

4. The method for determining eye openness with an eye tracking device of claim 1 , wherein the method further comprises:

determining, with the one or more processors, based on the image of the eye, that a center of the pupil is obscured by either eyelid; and

determining, with the one or more processors, based on the center of the pupil being obscured by either eyelid, that the eye of the user is closed.

5. The method for determining eye openness with an eye tracking device of claim 1 , wherein the method further comprises:

determining, with the one or more processors, based on the image of the eye, a maximum openness over time between either eyelid; and

determining, with the one or more processors, whether the eye of the user is closed, based on the maximum openness over time.

6. The method for determining eye openness with an eye tracking device of claim 5 , wherein determining whether the eye of the user is closed based on the maximum openness over time comprises:

determining, based on the image of the eye, that an openness of the eye is less than a predefined proportion of the maximum openness over time.

7. A computer-readable medium storing instructions that, when executed on a computer, carry out the method of claim 1 .

8. A system for determining eye openness with an eye tracking device, the system comprising a processor configured to:

receive an image of an eye of a user from an image sensor of an eye tracking device;

determine , based on the image of the eye, a radius of the pupil;

determine, based on the radius of the pupil, a total area of the pupil;

determine, based on the image of the eye and the radius of the pupil, an amount of the total area of the pupil which is not obscured by either eyelid; and

determine, based on the amount of the total area of the pupil which is not obscured by the eyelid and the total area of the pupil, whether the eye of the user is closed.

9. The system of claim 8 , wherein the processor is further configured to determine that, when the total area of the pupil which is not obscured is greater than a remainder of the pupil, the eye of the user is open.

10. The system of claim 8 , wherein the processor is further configured to determine that, when the total area of the pupil which is not obscured is less than a remainder of the pupil, the eye of the user is closed.

11. The system of claim 8 , wherein the processor is further configured to:

determine, based on the image of the eye, that a center of the pupil is obscured by either eyelid; and

determine, based on the center of the pupil being obscured by either eyelid, that the eye of the user is closed.

12. The system of claim 8 , wherein the processor is further configured to:

determining, with the one or more processors, based on the image of the eye, a maximum openness over time between either eyelid; and

determine whether the eye of the user is closed, based on the maximum openness over time.

13. The system of claim wherein the processor is further configured to:

determine whether the eye of the user is closed based on the maximum openness over time by determining, based on the image of the eye, that an openness of the eye is less than a predefined proportion of the maximum openness over time.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2019
From: RYAN, MARK; SUNDBERG, TORBJÖRN; RANA, PRAVIN; WANG, YIMU
To: TOBII AB
Reel/Frame 049565/0485 →
Continuity (3)
Continuation 15893340 · Feb 9, 2018
Provisional Application 62464235 · Feb 27, 2017
Related Publication 20200026068A1 · Jan 23, 2020
Cited By (1)
US 12,699,281