Human-computer interface system having a 3D gaze tracker
An apparatus for interfacing a person with a computer, the apparatus comprising a gaze tracker having a 3D camera and a picture camera that image the person and a controller that processes images acquired by the cameras to determine a gaze direction and point of regard of the person.
1. A system for interfacing a person with a computer, the system comprising:
a video display on which the computer is operable to generate an image to interact with the person;
a 3D camera to acquire a range image of the person located in a field of View (FOV) of the camera;
a picture camera to acquire a picture of the person in the FOV of the 3D camera; and
a controller to process the range image and the picture to determine spatial coordinates for features of the person's head and an eye of the person, to determine a gaze direction and origin for a gaze vector of the eye responsive to the determined spatial coordinates and to modify the image displayed on the video display responsive to the gaze vector.
2. A system according to claim 1 wherein modifying the displayed image comprises determining a point of regard (POR) responsive to the gaze vector and modifying the displayed image responsive to the POR.
3. A system according to claim 2 wherein modifying the displayed image responsive to the POR comprises generating an icon on the video display that indicates a location of the POR in the display.
4. A system according to claim 3 wherein the icon is configured to indicate a region of uncertainty (ROU) for the POR.
5. A system according to claim 1 , wherein the FOV extends from a distance from the gaze tracker equal to about 0.3 m.
6. A system according to claim 1 , wherein the FOV extends to a distance from the gaze tracker equal to or greater than about 2 m.
7. A system according to claim 1 and comprising a light source to illuminate at least a portion of the FOV.
8. A system according to claim 7 wherein the controller is operable to adjust intensity of light provided by the light source responsive to a spatial coordinate of the spatial coordinates determined by the controller.
9. A system according to claim 7 wherein the controller is operable to adjust direction of light provided by the light source responsive to a spatial coordinate of the spatial coordinates determined by the controller.
10. A system according to claim 1 , wherein the features comprise at least one feature of the person's eye for which spatial coordinates can be used to determine gaze direction of the eye.
11. A system according to claim 1 , wherein the features comprise at least one feature of the person's head for which spatial coordinates can be used to determine orientation of the head.
12. A system according to claim 1 , wherein the 3D camera comprises a stereoscopic camera.
13. A system according to claim 1 , wherein the 3D camera comprises a time of flight (TOF) 3D camera.
14. A system according to claim 1 , wherein the displayed image is associated with a video game.
15. A system according to claim 14 the video game is an online video game.
16. A system for interfacing a person with a video game, the system comprising:
a video display to display images associated with the video game;
a 3D camera to acquire a range image of the person located in a field of view (FOV) of the camera;
a picture camera to acquire a picture of the person in the FOV of the 3D camera; and
a controller operable to process the range image and the picture to determine spatial coordinates for features of the person's head and an eye of the person, to determine a gaze direction and origin for a gaze vector of the eye responsive to the determined spatial coordinates and to modify the image displayed on the video display responsive to the gaze vector.
17. A system according to claim 16 wherein modifying the displayed images responsive to the POR comprises generating an icon on the video display that indicates a location of the POR in the display.
18. A system according to claim 16 , wherein the features comprise at least one feature of the person's eye for which spatial coordinates can be used to determine gaze direction of the eye.
19. A system according to claim 16 , wherein the features comprise at least one feature of the person's head for which spatial coordinates can be used to determine orientation of the head.
20. A method of interfacing a person with a computer the method comprising:
acquiring a range image of a person that provides distances to the person's features;
acquiring a contrast image of the person;
processing the range and contrast images to provide a gaze vector for the person;
providing the computer with information related to the gaze vector; and
indicating to the person a point of regard determined responsive to the gaze vector.