Systems and methods for display binocular deformation compensation
A display subsystem for a virtual image generation system used by an end user, comprises first and second waveguide apparatuses, first and second projection subassemblies configured for introducing first and second light beams respectively into the first and second waveguide apparatuses, such that at least a first light ray and at least a second light ray respectively exit the first and second waveguide apparatuses to display first and second monocular images as a binocular image to the end user, and a light sensing assembly configured for detecting at least one parameter indicative of a mismatch between the displayed first and second monocular images as the binocular image.
1. A virtual image generation system for use by an end user, comprising:
left and right eyepieces;
left and right projection subassemblies configured for projecting light into the left and right eyepieces, such that left and right monocular images are displayed as a binocular image to the end user;
a light sensing assembly configured for detecting at least one parameter indicative of a mismatch between the displayed left and right monocular images as the binocular image;
a frame structure configured for being worn by the end user, the frame structure configured for respectively positioning the left and right eyepieces in front of the eyes of the end user; and
a control subsystem configured for correcting a mismatch between the left and right monocular images based on the at least one detected parameter detected by the light sensing assembly,
wherein the mismatch comprises a relative deformation between the left and right eyepieces.
2. The virtual image generation system of claim 1 , wherein the frame structure comprises a frame that carries the left and right eyepieces, and a bridge on which the light sensing assembly is affixed.
3. The virtual image generation system of claim 1 , wherein the light sensing assembly is optically coupled to the left and right eyepieces, but rigidly decoupled from the left and right eyepieces.
4. The virtual image generation system of claim 1 , wherein each of the left and right eyepieces comprises an out-coupling element configured for optically coupling light from the respective left and right eyepieces to the light sensing assembly, wherein the at least one detected parameter is derived from the light out-coupled from the left and right eyepieces.
5. The virtual image generation system of claim 4 , wherein the light sensing assembly comprises two independent sensing arrangements rigidly coupled to one another and configured for separately detecting the light out-coupled from the left and right eyepieces.
6. The virtual image generation system of claim 4 , wherein the light sensing assembly comprises:
no more than a single sensor configured for detecting the light out-coupled from the left and right eyepieces; and
an optical waveguide apparatus configured for propagating the light out-coupled from the left and right eyepieces to the single sensor.
7. The virtual image generation system of claim 1 , wherein the light sensing assembly comprises at least one non-imaging sensor, and the at least one detected parameter is indicative of an angle at which a first light ray exits the left eyepiece, and an angle at which a second light ray exits the right eyepiece.
8. The virtual image generation system of claim 7 ,
wherein the at least one detected parameter comprises intensities of two light rays respectively representative of the first light ray and the second light ray, and
wherein the representative light rays respectively exit the left and right eyepieces outside of a field of view of the end user.
9. The virtual image generation system of claim 1 , wherein the light sensing assembly comprises at least one imaging sensor, and the at least one detected parameter comprises left and right representative virtual monocular images respectively generated by the left and right eyepieces.
10. The virtual image generation system of claim 9 ,
wherein the left and right representative virtual monocular images are test virtual monocular images separate from the left and right virtual monocular images displayed to the end user, and
wherein the test virtual monocular images are displayed by the respective left and right eyepieces outside of the field of view of the end user.
11. The virtual image generation system of claim 1 , further comprising memory configured for storing a calibration profile for the left and right eyepieces, and the control subsystem is configured for correcting the mismatch between the left and right monocular images by modifying the stored calibration profile.
12. The virtual image generation system of claim 1 , wherein the at least one parameter is indicative of a spatial mismatch between the left and right eyepieces.
13. The virtual image generation system of claim 1 , wherein the light sensing assembly is external to the left and right eyepieces.
14. The virtual image generation system of claim 1 , wherein the light sensing assembly is configured to detect said relative deformation caused by deformation of the frame.
15. The virtual image generation system of claim 1 , wherein said correcting comprises directly tapping light intended for the left and right eyes of a user and comparatively sensing and correcting relative misalignments in virtual images.
16. The virtual image generation system of claim 1 , wherein said correcting comprises instructing the projection subassemblies to adjust a scan position of a collimated light beam for one or both of the eyepieces.
17. The virtual image generation system of claim 1 , further comprising a display subsystem comprising said left and right projection subassemblies, and wherein said left and right monocular images are displayed on said display subsystem and wherein said control system is configured for correcting by applying corrections to a subsequent image frame displayed on said display subsystem.
18. A head-mounted display system comprising:
a housing structure;
a pair of projection assemblies configured to emit light;
a light sensing assembly mounted to an inner surface of the housing structure;
a pair of eyepieces configured to optically couple the pair of projection assemblies to the light sensing assembly; and
one or more processors in communication with the pair of projection assemblies and the light sensing assembly, the one or more processors configured to control operation of the pair of projection assemblies based at least in part on data received from the light sensing assembly,
wherein the one or more processors are configured to control operation of the pair of projection assemblies by correcting a mismatch between left and right monocular images produced by said pair of projection assemblies, the mismatch due to a relative deformation between left and right eyepieces of said pair of eyepieces.
19. The head-mounted display system of claim 18 , wherein the housing structure comprises a frame that carries the pair of eyepieces, and a bridge on which the light sensing assembly is affixed, and wherein the frame comprises left and right cantilevered arms, the left eyepiece being affixed to the left cantilevered arm, and the right eyepiece being affixed to the right cantilevered arm.
20. The head-mounted display system of claim 18 , wherein the light sensing assembly is optically coupled to the pair of eyepieces, but rigidly decoupled from the pair of eyepieces.
21. The head-mounted display system of claim 18 , wherein each of the eyepieces comprises an out-coupling element configured for optically coupling light from the respective eyepieces to the light sensing assembly, wherein the at least one detected parameter is derived from the light out-coupled from the pair of eyepieces.
22. The head-mounted display system of claim 18 , further comprising memory configured for storing a calibration profile for the pair of eyepieces, wherein the one or more processors is configured for correcting the mismatch between the left and right monocular images by modifying the stored calibration profile.
23. The head-mounted display system of claim 18 , wherein the light sensing assembly is external to the pair of eyepieces.
24. The head-mounted display system of claim 18 , wherein the light sensing assembly comprises a pair of imaging sensors configured to capture images, the pair of imaging sensors comprising a first imaging sensor optically coupled to the first projection assembly by way of the first eyepiece, and a second imaging sensor optically coupled to the second projection assembly by way of the second eyepiece, and
wherein the one or more processors are configured to receive data representing images captured by the second imaging sensor, and control operation of the first projection assembly based at least in part on the data received from the second imaging sensor.
25. The head-mounted display system of claim 18 , wherein the pair of eyepieces are coupled to a frame of said housing and said relative deformation is caused by deformation of the frame.
26. The head-mounted display system of claim 18 , wherein the one or more processors are configured to control operation of the pair of projection assemblies by directly tapping light intended for the left and right eyes of a user and comparatively sensing and correcting relative misalignments in virtual images.
27. The head-mounted display system of claim 18 , wherein the one or more processors are configured to control operation of the pair of projection assemblies by adjusting a scan position of a collimated light beam for one or both of the pair of eyepieces.
28. The head-mounted display system of claim 18 , further comprising a display subsystem comprising said pair of projection assemblies, and wherein said left and right monocular images are displayed on said display subsystem and the one or more processors are configured to control operation of the pair of projection assemblies by applying corrections to a subsequent image frame displayed on said display subsystem.