SYSTEMS AND METHODS FOR DISPLAY BINOCULAR DEFORMATION COMPENSATION
A display subsystem for a virtual image generation system used by an end user, comprises first and second waveguide apparatuses, first and second projection subassemblies configured for introducing first and second light beams respectively into the first and second waveguide apparatuses, such that at least a first light ray and at least a second light ray respectively exit the first and second waveguide apparatuses to display first and second monocular images as a binocular image to the end user, and a light sensing assembly configured for detecting at least one parameter indicative of a mismatch between the displayed first and second monocular images as the binocular image.
1 . A display system comprising:
a pair of projection assemblies configured to emit light, the pair of projection assemblies comprising a first projection assembly and a second projection assembly;
a pair of eyepieces comprising:
a first eyepiece optically coupled to the first projection assembly;
a second eyepiece optically coupled to the second projection assembly;
a sensing assembly comprising a pair of imaging sensors configured to capture images, the pair of imaging sensors comprising:
a first imaging sensor optically coupled to the first projection assembly by way of the first eyepiece;
a second imaging sensor optically coupled to the second projection assembly by way of the second eyepiece; and
one or more processors in communication with the pair of projection assemblies and the pair of imaging sensors, the one or more processors configured to:
receive data representing images captured by the second imaging sensor; and
control operation of the first projection assembly based at least in part on the data received from the second imaging sensor.
2 . The display system of claim 1 , wherein the one or more processors are further configured to:
receive data representing images captured by the first imaging sensor; and
control operation of the second projection assembly based at least in part on the data received from the first imaging sensor.
3 . The display system of claim 2 , wherein to control operation of the first projection assembly based at least in part on the data received from the second imaging sensor, the one or more processors are configured to:
control operation of the first projection assembly based at least in part on the data received from the first and second imaging sensors.
4 . The display system of claim 2 , wherein to control operation of the second projection assembly based at least in part on the data received from the first imaging sensor, the one or more processors are configured to:
control operation of the second projection assembly based at least in part on the data received from the first and second imaging sensors.
5 . The display system of claim 1 , wherein the sensing assembly further comprises:
an elongated body physically coupled to the pair of imaging sensors.
6 . The display system of claim 5 , wherein the first imaging sensor is physically coupled to a first distal portion of the elongated body and the second imaging sensor is physically coupled to a second distal portion of the elongated body.
7 . The display system of claim 5 , wherein the first imaging sensor is physically coupled to the elongated body in lateral alignment with the second imaging sensor.
8 . The display system of claim 1 further comprising a housing structure, wherein the sensing assembly is mounted to an inner surface of the housing structure.
9 . The display system of claim 1 , wherein the one or more processors are further configured to:
generate images of a virtual scene from a perspective of a first render camera;
cause the first projection assembly to emit light representing images of the virtual scene as generated from the perspective of the first render camera;
generate images of the virtual scene from a perspective of a second render camera; and
cause the second projection assembly to emit light representing images of the virtual scene as generated from the perspective of the second render camera.
10 . The display system of claim 9 , wherein to control operation of the first projection assembly based at least in part on the data received from the second imaging sensor, the one or more processors are configured to:
control one or more extrinsic parameters of the first render camera based at least in part on the data received from the second imaging sensor.
11 . The display system of claim 9 , wherein the one or more processors are further configured to:
receive data representing images captured by the first imaging sensor; and
control operation of the second projection assembly based at least in part on the data received from the first imaging sensor, wherein to control operation of the second projection assembly based at least in part on the data received from the first imaging sensor, the one or more processors are configured to:
control one or more extrinsic parameters of the second render camera based at least in part on the data received from the first imaging sensor.