System and method for three-dimensional interaction based on gaze and system and method for tracking three-dimensional gaze
A gaze-based three-dimensional (3D) interaction system and method, as well as a 3D gaze tracking system and method, are disclosed. The gaze direction is determined by using the image of one eye of the operator who gazes at a 3D image, while the gaze depth is determined by the distance between pupil centers from both eyes of the operator shown in an image of both eyes of the operator.
1. A gaze-based three-dimensional (3D) interaction system, comprising:
a display unit configured to display a 3D image having objects with different depths;
two light sources respectively aligned at both sides of said display unit to provide lights;
an image capturing unit configured to capture an image of both eyes of an operator gazing at the 3D image, the image of the both eyes of the operator showing glints formed by the lights provided from said two light sources and two pupils in the both eyes;
a first signal processing unit configured to calculate a gaze direction to which the operator is gazing at the 3D image based on positions of two glints and a pupil at one of the eyes on the image of the both eyes and a gaze depth at which the operator is gazing at the 3D image based on a distance between the two pupils in the image of the both eyes;
a second signal processing unit configured to determine a gaze of the operator on said 3D image based on the gaze direction and the gaze depth; and
a third signal processing unit configured to execute a command the operator intended according to the determined gaze.
2. The system of claim 1 , wherein the light sources are infrared light emitting diodes (LED).
3. The system of claim 2 , wherein the image capturing unit is a digital camera having an infrared filter attached thereto.
4. The system of claim 1 , wherein the second signal processing unit selects a region corresponding to a depth related to the distance between the pupils shown by the image of the operator's both eyes and determines the gaze of the operator within the selected region based on the gaze depth and the gaze direction.
5. A gaze-based three-dimensional (3D) interaction method, comprising:
displaying a 3D image having objects with different depths;
providing lights on both eyes of an operator gazing at said 3D image by using two light sources;
capturing an image of both eyes of the operator, the image of both eyes of the operator showing glints formed by the lights provided from said light sources and two pupils in both eyes;
calculating a gaze direction to which the operator is gazing at the 3D image based on positions of two glints and a pupil at one of the eyes on the image of both eyes and a gaze depth at which the operator is gazing at the 3D image based on a distance between the two pupils in the image of the both eyes;
determining a gaze of the operator on said 3D image based on the gaze direction and the gaze depth; and
executing a command the operator intended according to the determined gaze.
6. The method of claim 5 , wherein a region corresponding to a depth related to the distance between the pupils shown by the image of the operator's both eyes is selected, and the gaze of the operator is determined within the selected region based on the gaze depth and the gaze direction.
7. A three-dimensional (3D) gaze tracking system, comprising:
a display unit configured to display a 3D image having objects with different depths;
two light sources respectively aligned at both sides of said display unit to provide lights;
an image capturing unit configured to capture an image of both eyes of an operator gazing at a 3D image, the image of both eyes of the operator showing glints formed by the lights provided from the two light sources and two pupils in the both eyes;
a first signal processing unit configured to calculate a gaze direction to which the operator is gazing at the 3D image based on positions of two glints and a pupil at one of the eyes on the image of the both eyes and a gaze depth at which the operator is gazing at the 3D image based on a distance between the two pupils in the image of the both eyes; and
a second signal processing unit configured to determine a gaze of the operator on said 3D image based on the gaze direction and the gaze depth.
8. The system of claim 7 , wherein the light sources are infrared light emitting diodes (LED).
9. The system of claim 8 , wherein the image capturing unit is a digital camera having an infrared filter attached thereto.
10. The system of claim 7 , wherein the second signal processing unit selects a region corresponding to a depth related to the distance between the pupils shown by the image of the operator's both eyes and determines the gaze of the operator within the selected region based on the gaze depth and the gaze direction.
11. A three-dimensional (3D) gaze tracking method, comprising:
displaying a 3D image having objects with different depths;
providing lights on both eyes of an operator gazing at said 3D image by using two light sources;
capturing an image of both eyes of the operator showing glints formed by the lights provided from said two light sources and two pupils in the both eyes;
calculating a gaze direction to which the operator is gazing at the 3D image based on positions of two glints and a pupil at one of the eyes on the image of the both eyes and a gaze depth at which the operator is gazing at the 3D image based on a distance between the two pupils in the image of the both eyes; and
tracking a gaze of the operator on said 3D image based on the gaze direction and the gaze depth.
12. The method of claim 11 , wherein a region corresponding to a depth related to the distance between the pupils shown by the image of the operator's both eyes is selected, and the gaze of the operator is tracked based on the gaze depth and the gaze direction.