IP Library Granted Patent US 9,237,844
Granted Patent B2
US 9,237,844 · App. 13/582,582 · Granted Jan 19, 2016

System and method for tracking the point of gaze of an observer

Inventors: Frederik Jan De Bruijn (Eindhoven, NL); Karl Catharina Van Bree (Eindhoven, NL); Tommaso Gritti (Eindhoven, NL)
Assignee: KONINKLIJKE PHILIPS N.V.
A61B3/113G06F3/013G06F3/147G06K9/0061G09G2380/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,237,844
App. No.
13/582,582
Granted
Jan 19, 2016
Kind
B2
Abstract

A system for tracking the point of gaze of an observer observing an object comprises a camera for recording an image of an eye of the observer, comprises a means for providing a luminous marker, and means for analyzing the image of the eye to determine the reflection of the marker on the eye and the centre of the pupil. The relative positions of the corneal reflection of the marker and the pupil centre are measured. The marker is repositioned, in dependence on the determined relative positions, to improve correspondence between the corneal reflection of the marker and the pupil center.

Claims (31)

1. A system for tracking a point of gaze of an observer observing an object, wherein the system comprises:

a device for recording an image of an eye of the observer;

a light source configured to provide a luminous marker on or associated with the observed object, said marker being selectively movable within a field of view of the observer; and

a control unit comprising a first image analyzer configured to analyze the image recorded by the image recording device, said first image analyzer being configured to determine, from the image, a corneal reflection of the marker on the eye of the observer and a center of a pupil of the eye of the observer,

wherein the system for tracking further comprises:

said first image analyzer being configured to determine relative positions of the corneal reflection of the marker and the pupil center;

said control unit comprising a second analyzer configured to receive the determined relative positions of the corneal reflection of the marker and the pupil center, and configured to generate data for repositioning the marker in order to lessen a difference between the determined relative positions of the corneal reflection of the marker and the pupil, until the position of the corneal reflection of the marker and the position of the pupil substantially coincide; and

means for repositioning the marker in response to the repositioning data.

2. The system as claimed in claim 1 , wherein the system further comprises a display device, and the position of the marker is related to the display device.

3. The system as claimed in claim 2 , wherein the display device and the light source for providing the marker are integrated into a single device.

4. The system as claimed in claim 2 , wherein the display device and the light source for providing the marker are separate devices.

5. The system as claimed in claim 4 , wherein the light source for providing the marker comprises a transparent shield positioned in front of an image screen of the display device.

6. The system as claimed in claim 1 , wherein the light source for providing the marker provides an infrared (IR) marker.

7. The system as claimed in claim 1 , wherein the marker is shaped in a pattern.

8. The system as claimed in claim 1 , wherein the light source for providing the marker and the repositioning means for repositioning the marker provide and reposition the marker in or on a transparent plate in front of a scene including the object.

9. The system as claimed in claim 8 , wherein the transparent plate is a windshield of a vehicle.

10. The system as claimed in claim 8 , wherein the transparent plate is a shop window.

11. The system as claimed in claim 3 , wherein the light source for providing the marker provides the marker in an image displayed on a display screen of the display device.

12. The system as claimed in claim 11 , wherein the marker is an IR marker.

13. The system as claimed in claim 11 , wherein the system comprises a Liquid Crystal Display device having an infrared (IR) backlight and a visible light backlight.

14. The system as claimed in claim 1 , wherein the light source for providing the marker comprise a transparent OLED screen for providing a marker.

15. The system as claimed in claim 1 , wherein the system is arranged to track the gaze of more than one observer, said system providing a respective additional single marker for each additional observer.

16. A method for tracking the point of gaze of an observer observing an object, wherein the method comprises:

recording an image of an eye of the observer;

providing a luminous marker on or associated with the observed object, said marker being selectively movable within a field of view of the observer; and

analyzing the image recorded by the image recording device in order to determine, from the image, a corneal reflection of the marker and a center of a pupil of the eye of the observer, wherein the method further comprises:

determining relative positions of the corneal reflection of a marker and the pupil center;

generating data for repositioning the marker in order to lessen a difference between the determined relative positions of the corneal reflection of the marker and the pupil; and

repositioning the marker in response to the repositioning data.

17. The method as claimed in claim 16 , wherein the marker is shaped in a pattern.

18. The method as claimed in claim 16 , wherein the marker is provided in or on a transparent plate.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2012
From: DE BRUIJN, FREDERIK JAN; VAN BREE, KARL CATHERINA; GRITTI, TOMMASO; SCHMEITZ, HAROLD AGNES WILHELMUS
To: KONINKLIJKE PHILIPS ELECTRONICS N.V.
Reel/Frame 028893/0134 →
Priority Claims (1)
EP 10157169 · Mar 22, 2010 · regional
Continuity (1)
Related Publication 20130002846A1 · Jan 3, 2013