Gaze tracking apparatus and systems
A gaze tracking system comprising a first camera operable to capture images of a user within an environment, a second camera, having a smaller field of view than the first camera, operable to capture images of at least one of the user's eyes, an eye identification unit operable to identify a location of at least one of the user's eyes from images captured by the first camera, a camera control unit operable to modify the position and/or orientation of the second camera in dependence upon the detected location of the at least one of the user's eyes, so as to cause the second camera to be able to capture images of at least one of the user's eyes, and a gaze direction identification unit operable to identify a gaze direction of the user from images captured by the second camera.
1. A gaze tracking system comprising:
a first camera operable to capture images of a user within an environment, where the first camera is neither held by the user nor affixed to a handheld object to be held by the user;
a second camera, having a smaller field of view than the first camera, operable to capture images of at least one of the user's eyes, where the second camera is at least one of held by the user or affixed to a handheld object to be held by the user;
an eye identification unit operable to identify a location of at least one of the user's eyes from images captured by the first camera;
a camera control unit operable to modify the position and/or orientation of the second camera in dependence upon the detected location of the at least one of the user's eyes, so as to cause the second camera to be able to capture images of at least one of the user's eyes; and
a gaze direction identification unit operable to identify a gaze direction of the user from images captured by the second camera.
2. The system of claim 1 , wherein the camera control unit is operable to cause the second camera to move about the environment.
3. The system of claim 1 , wherein one or both of the cameras is operable to capture images using infra-red light.
4. The system of claim 1 , wherein the second camera is operable to capture separate images of each of the user's eyes.
5. The system of claim 1 , wherein one or both of the cameras comprise a stereoscopic imaging arrangement.
6. The system of claim 1 , wherein the second camera comprises one or more sensors for detecting motion of the camera.
7. The system of claim 1 , wherein:
one or both of the cameras comprises a mirror element, and
the camera control unit is operable to modify the position and/or orientation of the mirror element to cause the corresponding camera to image a different part of the environment.
8. The system of claim 1 , wherein one or both the cameras comprise a micro-electromechanical system controllable by the camera control unit so as to allow modification of the position and/or orientation of the camera.
9. The system of claim 1 , wherein the camera control unit is operable to control camera motion in dependence upon a predicted movement of the user.
10. The system of claim 1 , comprising an input generation unit operable to generate one or more inputs in dependence upon the detected gaze direction.
11. A gaze tracking method for performing tracking using a first camera operable to capture images of a user within an environment and which is neither held by the user nor affixed to a handheld object to be held by the user, and a second camera having a smaller field of view than the first camera, being operable to capture images of at least one of the user's eyes, and which is at least one of held by the user or affixed to a handheld object to be held by the user, the method comprising:
capturing images of a user within an environment with the first camera;
identifying a location of at least one of the user's eyes from images captured by the first camera;
modifying the position and/or orientation of the second camera in dependence upon the detected location of the at least one of the user's eyes, so as to cause the second camera to be able to capture images of at least one of the user's eyes; and
identifying a gaze direction of the user from images captured by the second camera.
12. A non-transitory machine-readable storage medium which stores computer software which, when executed by a computer, causes the computer to perform a method for performing tracking using a first camera operable to capture images of a user within an environment and which is neither held by the user nor affixed to a handheld object to be held by the user, and a second camera having a smaller field of view than the first camera, being operable to capture images of at least one of the user's eyes, and which is at least one of held by the user or affixed to a handheld object to be held by the user, the method comprising:
capturing images of a user within an environment with the first camera;
identifying a location of at least one of the user's eyes from images captured by the first camera;
modifying the position and/or orientation of the second camera in dependence upon the detected location of the at least one of the user's eyes, so as to cause the second camera to be able to capture images of at least one of the user's eyes; and
identifying a gaze direction of the user from images captured by the second camera.