Object selection based on eye tracking in wearable device

1. A computer-implemented method, comprising:

capturing, by a camera mounted on a frame of a wearable computing device, images of an ambient environment outside of the wearable computing device;

triggering display, by a display device mounted on the frame of the wearable computing device, of the images captured by the camera;

tracking, by at least one gaze tracking device mounted on the frame of the wearable computing device, a user gaze directed at the images displayed by the display device of the wearable computing device; and

identifying a pixel area, of a plurality of pixel areas of the images displayed by the display device, corresponding to the user gaze, including:

detecting a fixation gaze directed at the images displayed by the display device, the fixation gaze being detected in response to movement of the user gaze having at least one of a magnitude or a frequency less than or equal to a set threshold; and

matching the pixel area with a corresponding object in the ambient environment.

2. The computer-implemented method of claim 1 , wherein the wearable computing device is a head mounted display device including the frame, with the camera, the display device and the at least one gaze tracking device all mounted to the frame, and the display device projecting the images of the ambient environment captured by the camera onto a lens of the head mounted display device.

3. The computer-implemented method of claim 1 , wherein capturing images of the ambient environment includes capturing portions of the ambient environment within a field of view of the camera as the wearable computing device changes at least one of position or orientation in the ambient environment.

4. The computer-implemented method of claim 1 , wherein tracking the user gaze includes tracking, by at least one eye gaze tracking device, eye gaze of at least one eye of a user of the wearable computing device.

5. The computer-implemented method of claim 1 , wherein tracking user gaze directed at the display of the images and identifying the pixel area corresponding to the user gaze includes:

identifying a fixation point of the fixation gaze at an intersection of the fixation gaze with the display of the images; and

identifying the pixel area at the intersection of the fixation gaze with the display of the images.

6. The computer-implemented method of claim 5 , wherein identifying the pixel area includes identifying a pixel within the display of the images at which the fixation gaze intersects the display of the images.

7. The computer-implemented method of claim 1 , wherein matching the pixel area with the corresponding object in the ambient environment includes:

analyzing an area surrounding the pixel area;

identifying features within the area surrounding the pixel area based on the analyzing;

recognizing at least one of the features; and

matching the pixel area to the corresponding object based on the at least one of the features.

8. The computer-implemented method of claim 7 , wherein recognizing the at least one of the features includes at least one of:

recognizing the at least one of the features based on a search of an external database of previously stored images; or

recognizing the at least one of the features based on known features of the ambient environment.

9. The computer-implemented method of claim 1 , wherein the tracking of the user gaze, the identifying of the pixel area, and the matching of the pixel area to the corresponding object in the ambient environment includes:

initiating, by a processor of the wearable computing device, a select mode of operation of the wearable computing device in response to at least one of a detected user input or detection of a stationary condition of the wearable computing device for greater than or equal to a previously set threshold of time; and

performing the tracking, the identifying and the matching only during operation of the wearable computing device in the select mode.

10. A computing system, comprising:

a wearable computing device, including:

a frame;

a camera coupled to the frame so as to capture images of an ambient environment outside of the wearable computing device;

a display device coupled to the frame;

at least one gaze tracking device coupled to the frame;

at least one processing device; and

a memory storing instructions that, when executed cause the computing system to perform operations, including:

capturing, by the camera, images of the environment outside of the wearable computing device;

triggering display, by the display device, of the images captured by the camera;

tracking, by the at least one gaze tracking device, a user gaze of the wearable computing device directed at the display of the images by the display device;

identifying a pixel area, of a plurality of pixel areas of the display of the images by the display device, corresponding to the user gaze, including:

detecting a fixation gaze directed at the display of images, the fixation gaze being detected in response to movement of the user gaze having at least one of a magnitude or a frequency less than or equal to a set threshold; and

matching the pixel area with a corresponding object in the ambient environment, including:

 identifying features within an area surrounding the pixel area;

 searching an external database of previously stored images;

 recognizing at least one of the features; and

matching the at least one of the features with the corresponding object in the ambient environment based on the searching of the external database.

11. The computing system of claim 10 , wherein the camera is configured to capture images of portions of the ambient environment within a field of view of the camera as the wearable computing device changes at least one of position or orientation in the ambient environment, and the instructions cause the computing system to perform operations including:

identifying a fixation point of the fixation gaze at an intersection of the fixation gaze with the display of the images; and

identifying the pixel area at the intersection of the fixation gaze with the display of the images.

12. The computing system of claim 11 , wherein the instructions cause the computing system to perform operations including:

analyzing the area surrounding the pixel area;

identifying the features within the area surrounding the pixel area based on the analyzing; and

matching the pixel area to the corresponding object based on the at least one of the features.

13. The computing system of claim 12 , wherein the instructions cause the computing system to perform operations including:

recognizing at least one of the features based on known features of the ambient environment.

14. The computing system of claim 10 , wherein the instructions also cause the computing system to perform operations including:

detecting a condition for entering a select mode of operation of the wearable computing device;

initiating operation of the wearable computing device in the select mode in response to detecting the condition; and

performing the tracking, the identifying and the matching only during operation of the wearable computing device in the select mode.

15. A non-transitory, machine-readable medium having instructions stored thereon that, when executed by a processor, cause a computing device to perform operations including:

capturing, by a camera mounted on a frame of a wearable computing device, images of objects within a field of view of the camera in an ambient environment outside of the wearable computing device;

triggering display, by a display device mounted on the frame of the wearable computing device, of the images captured by the camera;

tracking, by at least one gaze tracking device mounted on the frame of the wearable computing device, a user gaze directed at the display of the images by the display device;

identifying a pixel area, of a plurality of pixel areas of the display of the images by the display device, corresponding to the user gaze, including:

detecting a fixation gaze directed at the display of images, the fixation gaze being detected in response to movement of the user gaze having at least one of a magnitude or a frequency less than or equal to a set threshold; and

matching the pixel area with a corresponding object in the ambient environment, including:

identifying features within an area surrounding the pixel area;

recognizing at least one of the features based on a search of an external database of previously stored images; and

matching the at least one of the features to the corresponding object in the ambient environment.

16. The non-transitory, machine-readable medium of claim 15 , wherein the instructions also cause the computing device to perform operations including:

detecting a condition for entering a select mode of operation of the wearable computing device;

initiating operation of the wearable computing device in the select mode in response to detecting the condition; and

performing the tracking, the identifying and the matching only during operation of the wearable computing device in the select mode.

17. The non-transitory, machine-readable medium of claim 15 , wherein the instructions also cause the computing device to perform operations including:

tracking, by at the least one gaze tracking device, eye gaze of at least one eye of a user of the wearable computing device;

detecting the fixation gaze including fixation of the eye gaze directed at the display of the images;

identifying a fixation point of the fixation gaze at an intersection of the fixation gaze with the display of the images; and

identifying the pixel area at the intersection of the fixation gaze with the display of the images.

18. The non-transitory, machine-readable medium of claim 15 , wherein the instructions also cause the computing device to perform operations including:

analyzing the area surrounding the pixel area;

identifying the features within the area surrounding the pixel area based on the analyzing; and

matching the pixel area to the corresponding object based on the at least one identified feature.

19. The non-transitory, machine-readable medium of claim 18 , wherein the instructions also cause the computing device to perform operations including:

setting the corresponding object as a selected object; and

providing for interaction with the selected object through the wearable computing device.