Eye enrollment for head-mounted enclosure

1. A system, comprising:

an image sensor configured to capture an image of a face of a user, the image depicting an eye of the user and a head-mounted enclosure; and

one or more processors configured to:

determine, based on the image, an orientation of an eye of the user relative to the head-mounted enclosure,

determine, based on the orientation, a three-dimensional transform for a virtual camera associated with the eye of the user,

apply the three-dimensional transform to an output image to obtain a transformed image, and

project the transformed image from a display device, via an optical assembly of the head-mounted enclosure, to the eye of the user.

2. The system of claim 1 , wherein the orientation of the eye is encoded as a three-tuple of Euler angles.

3. The system of claim 1 , wherein the orientation of the eye is encoded as a quaternion expressed in a coordinate system of the head-mounted enclosure.

4. The system of claim 1 , wherein determining the three-dimensional transform includes retrieving a pre-calculated transform from a look-up table that is indexed by a quantized version of the orientation of the eye relative to the head-mounted enclosure.

5. The system of claim 1 , wherein the three-dimensional transform includes a perspective projection matrix.

6. The system of claim 5 , wherein the three-dimensional transform is determined relative to an origin of calibration in a coordinate system of the head-mounted enclosure.

7. The system of claim 1 , wherein the one or more processors are further configured to detect a marker on the head-mounted enclosure in the image, determine a position and orientation of the head-mounted enclosure in the image based on the marker, and determine the orientation of the eye of the user relative to the head-mounted enclosure based further on the position and orientation of the head-mounted enclosure in the image.

8. The system of claim 1 , wherein the image sensor is included in an external computing device that is separate from the head-mounted enclosure.

9. A system, comprising:

an image sensor configured to capture an image of a face of a user, the image depicting an eye of the user and a head-mounted enclosure; and

one or more processors configured to:

determine, based on the image, an orientation of an eye of the user relative to the head mounted enclosure,

determine, based on the orientation, a distortion map for an optical assembly associated with the eye of the user,

apply the distortion map to an output image to obtain a transformed image, and

project the transformed image from a display device, via an optical assembly of the head-mounted enclosure, to the eye of the user.

10. The system head mounted enclosure of claim 9 , wherein the orientation of the eye is encoded as a three-tuple of Euler angles.

11. The system head mounted enclosure of claim 9 , wherein the orientation of the eye is encoded as a quaternion expressed in a coordinate system of the head-mounted enclosure.

12. The system head mounted enclosure of claim 9 , wherein determining the distortion map includes retrieving a pre-calculated distortion map from a look-up table that is indexed by a quantized version of the orientation of the eye relative to the head-mounted enclosure.

13. The system of claim 9 , wherein the one or more processors are further configured to determine, based on a position of the eye, the distortion map for the optical assembly associated with the eye of the user.

14. The system of claim 9 , wherein the one or more processors are further configured to detect a marker on the head-mounted enclosure in the image, determine a position and orientation of the head-mounted enclosure in the image based on the marker, and determine the orientation of the eye of the user relative to the head-mounted enclosure based further on the position and orientation of the head-mounted enclosure in the image.

15. The system of claim 9 , wherein the image sensor is included in an external computing device that is separate from the head-mounted enclosure.

16. A head-mounted enclosure, comprising:

a display device having a front-facing camera configured to capture a reflected image while the user is wearing the head-mounted enclosure, wherein the reflected imaged depicts a reflection from an external mirror of both the face of the user and the head-mounted enclosure worn by the user; and

one or more processors configured to:

determine, based on the reflected image, a first orientation of a first eye of the user relative to the head-mounted enclosure and a second orientation of a second eye of the user relative to the head-mounted enclosure,

determine, based on the first orientation, a first three-dimensional transform,

determine, based on the second orientation, a second three-dimensional transform,

apply the first three-dimensional transform and the second three-dimensional transform to a first output image and a second output image to obtain a first transformed image and a second transformed image, and

project, via the display device, the first transformed image to the first eye of the user and the second transformed image to the second eye of the user.

17. The head-mounted enclosure of claim 16 , wherein the first orientation of the first eye and the second orientation of the second eye are encoded as three-tuples of Euler angles.

18. The head-mounted enclosure of claim 16 , wherein the first orientation of the first eye and the second orientation of the second eye are encoded as quaternions expressed in a coordinate system of the head-mounted enclosure.

19. The head-mounted enclosure of claim 16 , wherein the first three-dimensional transform includes a first projection matrix and the second three-dimensional transform includes a second projection matrix.

20. The head-mounted enclosure of claim 16 , wherein determining the first three-dimensional transform includes retrieving a first pre-calculated transform from a look-up table that is indexed by a quantized version of the first orientation of the first eye relative to the head-mounted enclosure, and determining the second three-dimensional transform includes retrieving a second pre-calculated transform from a look-up table that is indexed by a quantized version of the second orientation of the second eye relative to the head-mounted enclosure.