IP Library Granted Patent US 9,424,467
Granted Patent B2
US 9,424,467 · App. 13/830,226 · Granted Aug 23, 2016

Gaze tracking and recognition with image location

Inventor: Andrea Lawler (Los Angeles, CA)
Assignee: Disney Enterprises, Inc.
G06K9/00597G06K9/0061G06K9/00281G06F3/013G06K9/00604G06K9/00617G06T7/0038H04N13/0484
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,424,467
App. No.
13/830,226
Granted
Aug 23, 2016
Kind
B2
Abstract

An image of a person is captured. A left eye image is located in the image. A right eye image is located in the image. A first quantity of left eye white pixels and a second quantity of left eye white pixels in the left eye image locate are determined. A left eye image ratio of the first quantity of left eye white pixels to the second quantity of left eye white pixels is calculated. A first quantity of right eye white pixels and a second quantity of right eye white pixels in the right eye image is calculated. A right eye image ratio of the first quantity of right eye white pixels to the second quantity of right eye white pixels is calculated. A gaze direction of the person is determined based upon an average ratio.

Claims (50)

1. A computer program product comprising a non-transitory computer readable storage device having a computer readable program stored thereon, wherein the computer readable program while executing on a computer causes the computer to:

capture an image of a person;

locate a left eye image in the image;

locate a right eye image in the image;

determine a first quantity of left eye white pixels and a second quantity of left eye white pixels in the left eye image, the first quantity of left eye white pixels being determined from a distinct part of the left eye image than is the second quantity of left eye white pixels;

calculate a left eye image ratio of the first quantity of left eye white pixels to the second quantity of left eye white pixels;

determine a first quantity of right eye white pixels and a second quantity of right eye white pixels in the right eye image, the first quantity of right eye white pixels being determined from a distinct part of the right eye image than is the second quantity of right eye white pixels;

calculate a right eye image ratio of the first quantity of right eye white pixels to the second quantity of right eye white pixels;

mathematically adjust the left eye image ratio and/or the right eye image ratio based upon a head orientation of the person;

calculate an average ratio of the left eye image ratio and the right eye image ratio; and

determine a gaze direction of the person based upon the average ratio.

2. The computer program product of claim 1 , wherein the first quantity of left white eye pixels is measured from a left side of the left eye to an iris of the left eye.

3. The computer program product of claim 1 , wherein the second quantity of left white eye pixels is measured from a right side of the left eye to an iris of the left eye.

4. The computer program product of claim 1 , wherein the first quantity of right white eye pixels is measured from a right side of the right eye to an iris of the right eye.

5. The computer program product of claim 1 , wherein the second quantity of right white eye pixels is measured from a left side of the right eye to an iris of the right eye.

6. The computer program product of claim 1 , wherein the computer is further caused to provide gaze data based upon the gaze direction to an interactive device.

7. The computer program product of claim 6 , wherein the interactive device interacts with the person based upon the gaze data.

8. The computer program product of claim 6 , wherein the interactive device automatically adjusts a display based upon the gaze data.

9. The computer program product of claim 1 , wherein the computer is further caused to provide gaze data based upon the gaze to a motion capture system that generates animation data based upon the gaze data.

10. A method comprising:

capturing an image of a person;

locating a left eye image in the image;

locating a right eye image in the image;

determining a first quantity of left eye white pixels and a second quantity of left eye white pixels in the left eye image, the first quantity of left eye white pixels being determined from a distinct part of the left eye image than is the second quantity of left eye white pixels;

calculating a left eye image ratio of the first quantity of left eye white pixels to the second quantity of left eye white pixels;

determining a first quantity of right eye white pixels and a second quantity of right eye white pixels in the right eye image, the first quantity of right eye white pixels being determined from a distinct part of the right eye image than is the second quantity of right eye white pixels;

calculating a right eye image ratio of the first quantity of right eye white pixels to the second quantity of right eye white pixels;

mathematically adjusting the left eye image ratio and/or the right eye image ratio based upon a head orientation of the person;

calculating an average ratio of the left eye image ratio and the right eye image ratio; and

determining a gaze direction of the person based upon the average ratio.

11. The method of claim 10 , wherein the first quantity of left white eye pixels is measured from a left side of the left eye to an iris of the left eye.

12. The method of claim 10 , wherein the second quantity of left white eye pixels is measured from a right side of the left eye to an iris of the left eye.

13. The method of claim 10 , wherein the first quantity of right white eye pixels is measured from a right side of the right eye to an iris of the right eye.

14. The method of claim 10 , wherein the second quantity of right white eye pixels is measured from a left side of the right eye to an iris of the right eye.

15. The method of claim 10 , wherein further comprising providing gaze data based upon the gaze to an interactive device.

16. The method of claim 15 , wherein the interactive device interacts with the person based upon the gaze data.

17. The method of claim 15 , wherein the interactive device automatically adjusts a display based upon the gaze data.

18. The method of claim 10 , further comprising providing gaze data based upon the gaze direction to a motion capture system that generates animation data based upon the gaze data.

19. A system comprising:

an image capture device that captures an image of a person; and

a gaze tracking system that locates a left eye image in the image, locates a right eye image from the image, determines a first quantity of left eye white pixels and a second quantity of left eye white pixels in the left eye image, calculates a left eye image ratio of the first quantity of left eye white pixels to the second quantity of left eye white pixels, determines a first quantity of right eye white pixels and a second quantity of right eye white pixels in the right eye image, calculates a right eye image ratio of the first quantity of right eye white pixels to the second quantity of right eye white pixels, mathematically adjusts the left eye image ratio and/or the right eye image ratio based upon a head orientation of the person, calculates an average ratio of the left eye image ratio and the right eye image ratio, and determines a gaze of the person based upon the average ratio, the first quantity of left eye white pixels being determined from a distinct part of the left eye image than is the second quantity of left eye white pixels, the first quantity of right eye white pixels being determined from a distinct part of the right eye image than is the second quantity of right eye white pixels.

20. The system of claim 19 , further comprising an interactive device that receives gaze data based upon the gaze and interacts with the person based upon the gaze data.

21. A method comprising:

capturing an image of a person;

locating eye image data in the image;

determining a first quantity of white pixels and a second quantity of white pixels from the eye image data, the first quantity of white pixels being distinct from the second quantity of white pixels, the first quantity of white pixels being determined from a distinct part of the eye image data than is the second quantity of white pixels;

calculating a ratio of the first quantity of white pixels to the second quantity of white pixels;

mathematically adjusting the ratio based upon a head orientation of the person; and

determining a gaze direction of the person based upon the ratio.

22. The method of claim 21 , further comprising providing gaze data based upon the gaze direction to an interactive device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2013
From: LAWLER, ANDREA
To: DISNEY ENTERPRISES, INC.
Reel/Frame 030218/0754 →
Continuity (1)
Related Publication 20140267771A1 · Sep 18, 2014