Augmented reality head-mounted display with eye tracking for pupil steering

1. A head-mounted display device for providing augmented reality contents to a wearer, the device comprising:

a light projector configured to project light for rendering images based at least on the augmented reality contents;

an eye tracker configured to determine a position of a pupil of an eye of the wearer; and

a beam steerer configured to change a direction of the light from the light projector based on the position of the pupil, wherein:

the eye tracker includes a sensor configured to determine a distance to a surface on the eye of the wearer for determination of the position of the pupil of the eye of the wearer; and

the sensor is configured to determine the position of the pupil of the eye of the wearer by scanning a predefined area that includes the pupil of the eye of the wearer and obtaining a contour profile of the surface of the eye of the wearer.

2. The device of claim 1 , wherein:

the eye tracker is integrated with the light projector to form an integrated combination of the eye tracker and the light projector; and

the beam steerer is optically coupled with the integrated combination of the eye tracker and the light projector.

3. The device of claim 2 , further comprising:

one or more lenses optically coupled with the integrated combination of the eye tracker and the light projector, wherein the light projected by the light projector and the light reflected from the eye of the wearer detected by the eye tracker are both transmitted by the one or more lenses.

4. The device of claim 3 , wherein:

the one or more lenses are adjustable focus lenses.

5. The device of claim 2 , further comprising:

a combiner configured to combine the light from the light projector and light from an outside of the head-mounted display device for providing an overlap of the rendered images and a real image that corresponds to the light from the outside of the head-mounted display device.

6. The device of claim 5 , wherein:

the combiner is optically coupled with the integrated combination of the eye tracker and the light projector.

7. The device of claim 2 , wherein:

the light projector is configured to project light over an area that is within 6 mm×6 mm square area on a plane of the pupil of the eye of the wearer; and

the direction of the light from the light projector is adjusted by the beam steerer, based on the position of the pupil determined by the eye tracker.

8. The device of claim 1 , wherein:

determining, with the eye tracker, the position of the pupil of the eye of the wearer includes providing an infrared light to the eye of the wearer, and detecting, by the sensor, a light reflected from the surface of the eye of the wearer.

9. The device of claim 1 , wherein:

determining the distance to the surface on the eye of the wearer includes scanning, with the sensor, the predefined area that includes the pupil of the eye of the wearer and obtaining the contour profile of the surface of the eye of the wearer.

10. The device of claim 1 , wherein scanning the predefined area that includes the pupil of the eye of the wearer includes scanning in a raster pattern.

11. The device of claim 1 , wherein the sensor is a depth sensor based on a Time-of-Fly, Sound Navigation and Ranging, Light Detection and Ranging, interferometry, or light triangulation technique.

12. The device of claim 1 , wherein determining the distance to the surface of the eye of the wearer includes:

providing, with a light source, a first pulsed light at a first time toward the eye of the wearer;

detecting, by the sensor, the first pulsed light reflected off of the surface of the eye of the wearer at a second time; and

determining the distance between the sensor and the surface of the eye of the wearer based on a difference between the first time and the second time.

13. A head-mounted display device for providing augmented reality contents to a wearer, the device comprising:

a light projector configured to project light for rendering images based at least on the augmented reality contents;

an eye tracker configured to determine a position of a pupil of an eye of the wearer; and

a beam steerer, distinct and separate from the light projector, configured to change a direction of the light from the light projector based on the position of the pupil, wherein:

the light projector is configured to project a patterned light to the eye of the wearer; and

the eye tracker is a camera configured to capture an image of a reflection of the patterned light, reflected on a surface of the eye of the wearer.

14. The device of claim 13 , wherein:

the light projector is configured to:

provide a light to the eye of the wearer; and

produce a reflection on a surface the eye of the wearer, wherein at least a portion of the light produces a first reflection on a peripheral surface of a cornea of the eye of the wearer and at least a portion of the light produces a second reflection on a surface of a lens of the eye of the wearer; and

the eye tracker is configured detect a first intensity of the first reflection and a second intensity of the second reflection, and to determine, based on the first intensity and the second intensity, the position of the pupil of the eye of the wearer.

15. The device of claim 13 , wherein:

determining, with the eye tracker, the position of the pupil of the eye of the wearer includes obtaining the image of the reflection of the patterned light, reflected on the surface of the eye of the wearer.

16. The device of claim 13 , wherein:

determining, with the eye tracker, the position of the pupil of the eye of the wearer includes:

projecting, with the light projector, the patterned light to the eye of the wearer; and

capturing, with the camera, the image of a reflection of the patterned light, reflected on the surface of the eye of the wearer.

17. The device of claim 13 , wherein the patterned light includes a straight line pattern, a grid pattern, a dot matrix pattern, or a sinusoid pattern.

18. The device of claim 13 , wherein determining the position of the pupil of the eye of the wearer includes determining a surface profile of the eye of the wearer based on a distortion in the image of the reflection of the patterned light, reflected on the surface of the eye of the wearer.

19. A head-mounted display device for providing augmented reality contents to a wearer, the device comprising:

a light projector configured to project light for rendering images based at least on the augmented reality contents;

an eye tracker configured to determine a position of a pupil of an eye of the wearer; and

a beam steerer configured to change a direction of the light from the light projector based on the position of the pupil, wherein:

the eye tracker is integrated with the light projector to form an integrated combination of the eye tracker and the light projector;

the beam steerer is optically coupled with the integrated combination of the eye tracker and the light projector; and

the device is configured to:

determine, with the eye tracker, a position of a pupil of an eye of the wearer;

project, with the light projector, light for rendering images based at least on the augmented reality contents; and

change, with the beam steerer, a direction of the light from the light projector based on the position of the pupil, wherein determining, with the eye tracker, the position of the pupil of the eye of the wearer includes:

providing, with the light projector,

light having a particular intensity to the eye of the wearer; producing a reflection on a surface of the eye of the wearer in response to providing the light having the particular intensity to the eye, wherein at least a portion of the light produces a first reflection on a peripheral surface of a cornea of the eye of the wearer and at least a portion of the light produces a second reflection on a surface of a lens of the eye of the wearer;

detecting, with the eye tracker, a first intensity of the first reflection and a second intensity of the second reflection; and

determining, based on the first intensity and the second intensity, the position of the pupil of the eye of the wearer.