Device and method for controlling mouse using gaze recognition
An apparatus and method for controlling a mouse using gaze recognition are provided. The method includes measuring a distance between eyes of a user and a gaze recognizer in response to a user gazing at an object displayed on a display, setting a size of a mouse pointer based on at least one of the measured distance and a display resolution, performing calibration based on the set size of the mouse pointer, displaying the mouse pointer created based on the calibration on a display, determining occurrence of gaze recognition-based mouse shaking, and controlling a movement of the mouse pointer based on the gaze recognition-based mouse shaking.
1 . A processor-implemented method for controlling a mouse using gaze recognition, the method comprising:
measuring a distance between eyes of a user and a gaze recognizer in response to a user gazing at an object displayed on a display;
setting a size of a mouse pointer based on at least one of the measured distance and a display resolution;
performing calibration based on the set size of the mouse pointer;
displaying the mouse pointer based on the calibration on a display;
determining occurrence of mouse shaking via gaze recognition by the gaze recognizer; and
controlling a movement of the mouse pointer based on the mouse shaking,
wherein the setting of the size of the mouse pointer comprises:
setting a minimum size of the mouse pointer based on the measured distance;
checking a maximum size of the pointer based on a button layout within a screen;
checking a display resolution-pointer size;
determining whether the display resolution-pointer size is smaller than the minimum size of the mouse pointer based on the measured distance; and
increasing the size of the pointer within the screen such that the pointer is displayed in a physical minimum size in response to the display resolution-pointer size being smaller than the pointer minimum size.
2 . The method of claim 1 , wherein the performing of the calibration based on the set size of the mouse pointer comprises:
performing the calibration for eye location and movement based on the mouse shaking;
determining a shaking range based on a gazed point based on the user gaze; and
creating the size of the mouse pointer based on the determined shaking range.
3 . The method of claim 2 , wherein the displaying of the mouse pointer created based on the calibration on the display comprises:
determining whether the display resolution-pointer size is equal to or smaller than a maximum size of the mouse pointer created by the calibration;
limiting the size of the mouse pointer up to the maximum size in response to the display resolution-pointer size not being equal to or smaller than the maximum size of the mouse pointer created by the calibration; and
displaying the mouse pointer whose size is limited up to the maximum size on the display.
4 . The method of claim 3 , wherein the controlling of the movement of the mouse pointer based on the mouse shaking comprises:
determining whether the mouse shaking occurs;
determining whether the shaking range is greater than an area of the created mouse pointer in response to the mouse shaking;
controlling the mouse pointer to move in response to the shaking range being greater than the area of the mouse pointer; and
controlling a location of the mouse pointer to be fixed in response to the shaking range being smaller than the area of the mouse pointer.
5 . The method of claim 4 , further comprising:
fixing an existing mouse pointer location when the shaking range is greater than an area of the mouse pointer.
6 . A device for controlling a mouse using gaze recognition, the device comprising:
a display configured to display data, information, or contents on a screen;
a gaze recognizer configured to capture a facial image of a user gazing at the screen of the display to recognize a user's gaze;
a distance measurer configured to measure a distance between user's eyes and the gaze recognizer; and
a mouse controller configured to, in response to a user gazing at an object displayed on the display:
control a mouse pointer based on the results recognized and measured by the gaze recognizer and the distance measurer;
set a size of the mouse pointer based on at least one of the measured distance and a display resolution;
perform calibration based on the set size of the mouse pointer;
display the mouse pointer based on the calibration on the display;
determine occurrence of mouse shaking via gaze recognition by the gaze recognizer; and
control a movement of the mouse pointer based on the mouse shaking,
wherein the mouse controller is further configured to:
set a minimum size of the mouse pointer based on the measured distance;
check a maximum size of the pointer based on a button layout within the screen;
check a display resolution-pointer size;
determine whether the display resolution-pointer size is smaller than the minimum size of the mouse pointer based on the measured distance; and
increase the size of the pointer within the screen such that the pointer is displayed in a physical minimum size in response to the display resolution-pointer size being smaller than the pointer minimum size.
7 . The device of claim 6 , wherein the mouse controller is further configured to:
perform the calibration for eye location and movement based on the mouse shaking;
determine a shaking range based on a gazed point based on the user gaze; and
create the size of the mouse pointer based on the determined shaking range.
8 . The device of claim 7 , wherein the mouse controller is further configured to:
determine whether the display resolution-pointer size is equal to or smaller than a maximum size of the mouse pointer created by the calibration;
limit the size of the mouse pointer up to the maximum size in response to the display resolution-pointer size not being equal to or smaller than the maximum size of the mouse pointer created by the calibration; and
display the mouse pointer whose size is limited up to the maximum size on the display.
9 . The device of claim 8 , wherein the mouse controller is further configured to:
determine whether the mouse shaking occurs;
determine whether the shaking range is greater than an area of the created mouse pointer in response to the mouse shaking;
control the mouse pointer to move in response to the shaking range being greater than the area of the mouse pointer; and
control a location of the mouse pointer to be fixed in response to the shaking range being smaller than the area of the mouse pointer.
10 . The device of claim 9 , wherein the mouse controller is further configured to fix an existing mouse pointer location when the shaking range is greater than the area of the mouse pointer.