Display systems and methods for determining vertical alignment between left and right displays and a user's eyes
A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive image information outputted by the HMD. For example, the HAMID-to-eye vertical alignment may be different between the left and right eyes. The wearable device may determine if the HMD is level on the user's head and may then provide the user with a left-eye alignment marker and a right-eye alignment marker. Based on user feedback, the wearable device may determine if there is any left-right vertical misalignment and may take actions to reduce or minimize the effects of any misalignment.
1. An augmented reality system comprising:
a head-mounted display configured to present virtual content by outputting light to a user, the head-mounted display comprising a left-eye display including a first waveguide stack comprising a plurality of waveguides configured to present virtual content to the user's left eye and a right-eye display including a second waveguide stack comprising a plurality of waveguides configured to present virtual content to the user's right eye; and
at least one processor communicatively coupled to the head-mounted display, the at least one processor configured to:
conduct a plurality of alignment processes for the first waveguide stack and the second waveguide stack, wherein an alignment process is conducted for each waveguide of the first and second waveguide stacks, wherein each alignment process comprises:
providing, with a waveguide of the left-eye display being aligned, a left-eye alignment marker;
providing, with a waveguide of the right-eye display being aligned, a right-eye alignment marker;
receiving user input to adjust at least one of the left-eye and the right-eye alignment markers; and
vertically adjusting image content in the waveguide being aligned of at least one of the left-eye and right-eye displays based on the received user input.
2. The augmented reality system of claim 1 , wherein the left-eye alignment marker comprises a first horizontal line and wherein the right-eye alignment marker comprises a second horizontal line.
3. The augmented reality system of claim 2 , wherein the processor is configured to receive user input to adjust at least one of the left-eye and right-eye alignment markers in the form of user input to raise or lower at least one of the first and second horizontal lines.
4. The augmented reality system of claim 2 , wherein the processor is configured to receive user input to adjust at least one of the left-eye and right-eye alignment markers in the form of user input to raise or lower at least one of the first and second horizontal lines until the first and second horizontal lines are level from the perspective of the user.
5. The augmented reality system of claim 1 , wherein the first waveguide stack is configured to pass light from the world into the left eye of the user and the second waveguide stack is configured to pass light from the world into the right eye of the user.
6. The augmented reality system of claim 1 , wherein the first waveguide stack is configured to pass light from the world into the left eye of the user and the second waveguide stack is configured to pass light from the world into the right eye of the user,
wherein one or more waveguides of each waveguide stack are configured to output light to the user with a different amount of wavefront divergence than one or more other waveguides of that waveguide stack,
wherein different amounts of wavefront divergence are associated with different accommodation by the eye, and
wherein the outputted light with different amounts of wavefront divergence forms virtual objects at different perceived depths away from the user.
7. The augmented reality system of claim 1 , wherein to provide, with the left-eye display and the right-eye display, the left-eye alignment marker and the right-eye alignment marker, respectively, the at least one processor is configured to:
provide, with the left-eye display, a first vertical alignment marker and a first horizontal alignment marker; and
provide, with the right-eye display, a second vertical alignment marker and a second horizontal alignment marker.
8. The augmented reality system of claim 7 , wherein, when viewed by the user, the first and second vertical alignment markers fuse together in the user's vision and the first and second horizontal alignment markers remain unfused in the user's vision.
9. The augmented reality system of claim 7 , wherein to receive user input to adjust at least one of the left-eye and the right-eye alignment markers, the at least one processor is configured to:
receive user input to move at least one of the first and second horizontal alignment markers vertically.
10. The augmented reality system of claim 7 , wherein to receive user input to adjust at least one of the left-eye and the right-eye alignment markers, the at least one processor is configured to:
receive user input to move at least one of the first and second horizontal alignment markers vertically until the first and second horizontal alignment markers are vertically aligned with each other in the user's vision.
11. The augmented reality system of claim 1 , wherein the at least one processor is further configured to:
select a first vertical position at which to present the left-eye alignment marker; and
select a second vertical position at which to present the right-eye alignment marker, and
wherein to provide, with the left-eye display and the right-eye display, the left-eye alignment marker and the right-eye alignment marker, respectively, the at least one processor is configured to:
provide, with the left-eye display, the left-eye alignment marker at the first vertical position; and
provide, with the right-eye display, the right-eye alignment marker at the second vertical position.
12. The augmented reality system of claim 11 , wherein to select the first vertical position at which to present the left-eye alignment marker and select the second vertical position at which to present the right-eye alignment marker, the at least one processor is configured to:
pseudo- or quasi-randomly select the first vertical position at which to present the left-eye alignment marker; and
pseudo- or quasi-randomly select the second vertical position at which to present the right-eye alignment marker.
13. The augmented reality system of claim 11 , wherein to vertically adjust image content in the at least one of the left-eye and right-eye displays based on the received user input, the at least one processor is configured to:
vertically adjust image content in the at least one of the left-eye and right-eye displays based on the received user input, the first vertical position selected, and the second vertical position selected.
14. The augmented reality system of claim 1 , wherein to vertically adjust image content in the at least one of the left-eye and right-eye displays based on the received user input, the at least one processor is configured to:
adjust one or more extrinsic parameters of at least one of a first render camera that is associated with the left-eye display and a second render camera that is associated with the right-eye display.
15. The augmented reality system of claim 14 , wherein the one or more extrinsic parameters include at least one of a position and an orientation.
16. The augmented reality system of claim 1 , further comprising an imaging system configured to capture images of eyes of the user, and
wherein the at least one processor is communicatively coupled to the imaging system, the at least one processor further configured to:
determine whether the head-mounted display is level relative to the user's left and right eyes based at least in part on one or more images captured by the imaging system.
17. The augmented reality system of claim 16 , wherein the at least one processor is configured to provide, with the left-eye display and the right-eye display, the left-eye alignment marker and the right-eye alignment marker, respectively, in response to a determination that the head-mounted display is level relative to the user's left and right eyes.