User input processing with eye tracking
A system determines which user of multiple users provided input through a single input device. A mechanism captures images of the one or more users. When input is detected, the images may be processed to determine which user provided an input using the input device. The images may be processed to identify each users head and eyes, and determine the focus point for each user's eyes. The user which has eyes focused at the input location is identified as providing the input. When the input mechanism is a touch screen, the user having eyes focused on the touch screen portion which was touched is identified as the source of the input.
1. A method for identifying input based on eye focus, the method comprising:
identifying a location of an iris of a user based on an analysis of an initial image acquired by a camera;
capturing image data for a physical area proximate to a computing device, the image data captured by the camera;
evaluating the captured image data to identify a plurality of portion areas of an eye of the user present in the physical area;
tracking movement of a focal point of the eye of the user based on the identified location of the iris;
identifying one or more changes to relative sizes of the portion areas;
generating a display of a virtual item associated with a predefined input point of the display;
identifying when the tracked focal point moves to a location of the virtual item within the generated display; and
activating the predefined input point associated with the virtual item, wherein activating the predefined input point includes displaying new data at the location of the virtual item within the display.
2. The method of claim 1 , further comprising identifying that the user has touched the virtual item to activate the predefined input point.
3. The method of claim 1 , further comprising:
displaying a first virtual item at a first location on the display when calibrating the movement tracking;
identifying that a first focus point of the eye of the user corresponds to the first location of the first virtual item;
displaying the first virtual item at a second location on the display; and
completing the calibration of the movement tracking after identifying that a second focus point of the eye of the user corresponds to the second location on the display.
4. The method of claim 1 , wherein the portion areas include a first sclera area and a second sclera area, and further comprising identifying the changes to the relative sizes by comparing a size of the first sclera area to a size of the second sclera area.
5. The method of claim 1 , further comprising:
identifying an object that is a distance away from the computing device; and
identifying the distance that the object is away from the computing device based on an analysis of the captured image data.
6. The method of claim 1 , further comprising:
identifying a set of eyes of a second user; and
calibrating eye motion of the set of eyes of the second user by:
displaying a first virtual item at a first location on the display,
identifying that a first focus point of the set of eyes corresponds to the first location of the first virtual item,
displaying the first virtual item at a second location on the display, and
completing the calibration of the eye motion of the second user after identifying that a second focus point of the set of eyes corresponds to the second location on the display.
7. The method of claim 1 , wherein the camera is a color camera, and further comprising processing color data collected by the color camera.
8. The method of claim 1 , wherein the camera is an infrared (IR) camera.
9. A non-transitory computer-readable storage medium having embodied thereon a program executable by a processor to implement a method for identifying input based on eye focus, the method comprising:
identifying a location of an iris of a user based on an analysis of an initial image acquired by a camera;
capturing image data for a physical area proximate to a computing device, the image data captured by the camera;
evaluating the captured image data to identify a plurality of portion areas of an eye of the user present in the physical area;
tracking movement of a focal point of the eye of the user based on the identified location of the iris;
identifying one or more changes to relative sizes of the portion areas;
generating a display of a virtual item associated with a predefined input point of the display;
identifying when the tracked focal point moves to a location of the virtual item within the generated display; and
activating the predefined input point associated with the virtual item, wherein activating the predefined input point includes displaying new data at the location of the virtual item within the display.
10. The non-transitory computer-readable storage medium of claim 9 , the program further executable to identify that the user has touched the virtual item to activate the predefined input point.
11. The non-transitory computer-readable storage medium of claim 9 , the program further executable to:
display a first virtual item at a first location on the display when calibrating the movement tracking;
identify that a first focus point of the eye of the user corresponds to the first location of the first virtual item;
display the first virtual item at a second location on the display; and
complete the calibration of the movement tracking after identifying that a second focus point of the eye of the user corresponds to the second location on the display.
12. The non-transitory computer-readable storage medium of claim 9 , wherein the portion areas include a first sclera area and a second sclera area, and the program further executable to identify changes in the relative sizes by comparing a size of the first sclera area to a size of the second sclera area.
13. The non-transitory computer-readable storage medium of claim 9 , the program further executable to:
identify an object that is a distance away from the computing device; and
identify the distance that the object is away from the computing device based on an analysis of the captured image data.
14. The non-transitory computer-readable storage medium of claim 9 , the program further executable to:
identify a set of eyes of a second user; and
calibrate eye motion of the set of eyes of the second user by:
displaying a first virtual item at a first location on the display,
identifying that a first focus point of the set of eyes corresponds to the first location of the first virtual item,
displaying the first virtual item at a second location on the display, and
completing the calibration the eye motion of the second user after identifying that a second focus point of the set of eyes corresponds to the second location on the display.
15. The non-transitory computer-readable storage medium of claim 9 , wherein the camera includes a color camera, and the program is further executable to process color data collected by the color camera.
16. A system for identifying input based on eye focus, the system comprising:
a camera that captures image data for a physical area proximate to a computing device;
a memory;
a processor that executes instructions out of the memory to:
identifying a location of an iris of a user based on an analysis of an initial image acquired by the camera,
evaluate the captured image data to identify a plurality of portion areas of an eye of the user present in the physical area,
track movement of a focal point of the eye of the user based on the identified location of the iris, and
identifying one or more changes to relative sizes of the portion areas; and
a display that displays a virtual item associated with a predefined input point of the display, wherein the processor also executes instructions out of the memory to:
identify when the tracked focal point moves to a location of the virtual item within the display, and
activate the predefined input point associated with the virtual item, the activating of the predefined input point including displaying new data at the location of the virtual item within the display.