IP Library Granted Patent US 12,429,946
Granted Patent B2
US 12,429,946 · App. 18/818,343 · Granted Sep 30, 2025

Display systems and methods for determining vertical alignment between left and right displays and a user's eyes

Inventor: Bjorn Nicolaas Servatius Vlaskamp (Plantation, FL)
Assignee: MAGIC LEAP, INC.
G06F3/013G02B6/0076G02B27/0172G09G5/38H04N13/344G02B2027/014G09G2320/0606G09G2320/0693G09G2354/00G09G2356/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,429,946
App. No.
18/818,343
Granted
Sep 30, 2025
Kind
B2
Abstract

A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive image information outputted by the HMD. For example, the HMD-to-eye vertical alignment may be different between the left and right eyes. The wearable device may determine if the HMD is level on the user's head and may then provide the user with a left-eye alignment marker and a right-eye alignment marker. Based on user feedback, the wearable device may determine if there is any left-right vertical misalignment and may take actions to reduce or minimize the effects of any misalignment.

Claims (57)

1. An augmented reality system comprising:

a head-mounted display configured to present virtual content by outputting light to a user, the head-mounted display comprising a left-eye display configured to present virtual content to the user's left eye and a right-eye display configured to present virtual content to the user's right eye; and

at least one processor communicatively coupled to the head-mounted display, the at least one processor configured to:

provide, with the left-eye display, a left-eye alignment marker;

provide, with the right-eye display, a right-eye alignment marker;

receive user input to adjust at least one of the left-eye and the right-eye alignment markers; and

vertically adjust image content in the at least one of the left-eye and right-eye displays based on the received user input by adjusting one or more extrinsic parameters of at least one of a first render camera that is associated with the left-eye display and a second render camera that is associated with the right-eye display.

2. The augmented reality system of claim 1 , wherein the one or more extrinsic parameters include at least one of a position and an orientation.

3. The augmented reality system of claim 1 , wherein the left-eye alignment marker comprises a first horizontal line and wherein the right-eye alignment marker comprises a second horizontal line.

4. The augmented reality system of claim 1 , wherein to provide, with the left-eye display and the right-eye display, the left-eye alignment marker and the right-eye alignment marker, respectively, the at least one processor is configured to:

provide, with the left-eye display, a first vertical alignment marker and a first horizontal alignment marker; and

provide, with the right-eye display, a second vertical alignment marker and a second horizontal alignment marker.

5. The augmented reality system of claim 1 , wherein the at least one processor is further configured to:

select a first vertical position at which to present the left-eye alignment marker; and

select a second vertical position at which to present the right-eye alignment marker, and

wherein to provide, with the left-eye display and the right-eye display, the left-eye alignment marker and the right-eye alignment marker, respectively, the at least one processor is configured to:

provide, with the left-eye display, the left-eye alignment marker at the first vertical position; and

provide, with the right-eye display, the right-eye alignment marker at the second vertical position.

6. The augmented reality system of claim 5 , wherein to select the first vertical position at which to present the left-eye alignment marker and select the second vertical position at which to present the right-eye alignment marker, the at least one processor is configured to:

pseudo- or quasi-randomly select the first vertical position at which to present the left-eye alignment marker; and

pseudo- or quasi-randomly select the second vertical position at which to present the right-eye alignment marker.

7. The augmented reality system of claim 5 , wherein to vertically adjust image content in the at least one of the left-eye and right-eye displays based on the received user input, the at least one processor is configured to:

vertically adjust image content in the at least one of the left-eye and right-eye displays based on the received user input, the first vertical position selected, and the second vertical position selected.

8. The augmented reality system of claim 1 , further comprising an imaging system configured to capture images of eyes of the user, and

wherein the at least one processor is communicatively coupled to the imaging system, the at least one processor further configured to:

determine whether the head-mounted display is level relative to the user's left and right eyes based at least in part on one or more images captured by the imaging system.

9. The augmented reality system of claim 8 , wherein the at least one processor is configured to provide, with the left-eye display and the right-eye display, the left-eye alignment marker and the right-eye alignment marker, respectively, in response to a determination that the head-mounted display is level relative to the user's left and right eyes.

10. The augmented reality system of claim 1 , wherein the left-eye display comprises a first waveguide stack and the right-eye display comprises a second waveguide stack, each of which comprises a plurality of waveguides configured to output light to the user, and

wherein to provide, with the left-eye display and the right-eye display, the left-eye alignment marker and the right-eye alignment marker, respectively, the at least one processor is configured to:

provide, with a single one of the plurality of waveguides in the first waveguide stack, the left-eye alignment marker; and

provide, with a single one of the plurality of waveguides in the second waveguide stack, the right-eye alignment marker.

11. An augmented reality system comprising:

a head-mounted display configured to present virtual content by outputting light to a user, the head-mounted display comprising a left-eye display configured to present virtual content to the user's left eye and a right-eye display configured to present virtual content to the user's right eye; and

at least one processor communicatively coupled to the head-mounted display, the at least one processor configured to:

pseudo- or quasi-randomly select a first vertical position at which to present a left-eye alignment marker;

pseudo- or quasi-randomly select a second vertical position at which to present a right-eye alignment marker;

provide, with the left-eye display, the left-eye alignment marker at the first vertical position;

provide, with the right-eye display, the right-eye alignment marker at the second vertical position;

receive user input to adjust at least one of the left-eye and the right-eye alignment markers; and

vertically adjust image content in the at least one of the left-eye and right-eye displays based on the received user input.

12. The augmented reality system of claim 11 , wherein the left-eye alignment marker comprises a first horizontal line and wherein the right-eye alignment marker comprises a second horizontal line.

13. The augmented reality system of claim 11 , wherein to provide, with the left-eye display and the right-eye display, the left-eye alignment marker and the right-eye alignment marker, respectively, the at least one processor is configured to:

provide, with the left-eye display, a first vertical alignment marker and a first horizontal alignment marker; and

provide, with the right-eye display, a second vertical alignment marker and a second horizontal alignment marker.

14. The augmented reality system of claim 11 , wherein to vertically adjust image content in the at least one of the left-eye and right-eye displays based on the received user input, the at least one processor is configured to:

vertically adjust image content in the at least one of the left-eye and right-eye displays based on the received user input, the first vertical position selected, and the second vertical position selected.

15. The augmented reality system of claim 11 , wherein to vertically adjust image content in the at least one of the left-eye and right-eye displays based on the received user input, the at least one processor is configured to:

adjust one or more extrinsic parameters of at least one of a first render camera that is associated with the left-eye display and a second render camera that is associated with the right-eye display.

16. The augmented reality system of claim 15 , wherein the one or more extrinsic parameters include at least one of a position and an orientation.

17. The augmented reality system of claim 11 , further comprising an imaging system configured to capture images of eyes of the user, and

wherein the at least one processor is communicatively coupled to the imaging system, the at least one processor further configured to:

determine whether the head-mounted display is level relative to the user's left and right eyes based at least in part on one or more images captured by the imaging system.

18. The augmented reality system of claim 17 , wherein the at least one processor is configured to provide, with the left-eye display and the right-eye display, the left-eye alignment marker and the right-eye alignment marker, respectively, in response to a determination that the head-mounted display is level relative to the user's left and right eyes.

19. The augmented reality system of claim 11 , wherein the left-eye display comprises a first waveguide stack and the right-eye display comprises a second waveguide stack, each of which comprises a plurality of waveguides configured to output light to the user, and

wherein to provide, with the left-eye display and the right-eye display, the left-eye alignment marker and the right-eye alignment marker, respectively, the at least one processor is configured to:

provide, with a single one of the plurality of waveguides in the first waveguide stack, the left-eye alignment marker; and

provide, with a single one of the plurality of waveguides in the second waveguide stack, the right-eye alignment marker.

Assignments (2)
SECURITY INTEREST Recorded Oct 29, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073430/0225 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2025
From: VLASKAMP, BJORN NICOLAAS SERVATIUS
To: MAGIC LEAP, INC.
Reel/Frame 069808/0115 →
Continuity (5)
Continuation 18486848 · Oct 13, 2023
Continuation 17890998 · Aug 18, 2022
Continuation 17258083
Provisional Application 62702865 · Jul 24, 2018
Related Publication 20240419243A1 · Dec 19, 2024
References Cited (59)
US 6850221B1 · Tickle · 2005 [cited by applicant]
US 9094677B1 · Mendis et al. · 2015 [cited by applicant]
US 9116545B1 · Raffle et al. · 2015 [cited by applicant]
US 10650785B1 · Tuomisto et al. · 2020 [cited by applicant]
US 10678059B1 · Sirimamilla et al. · 2020 [cited by applicant]
US 11422620B2 · Vlaskamp · 2022 [cited by applicant]
US 12105875B2 · Vlaskamp · 2024 [cited by examiner]
US 20020028045A1 · Yoshimura et al. · 2002 [cited by applicant]
US 20060028436A1 · Armstrong · 2006 [cited by applicant]
US 20070081123A1 · Lewis · 2007 [cited by applicant]
US 20120127062A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120162549A1 · Gao et al. · 2012 [cited by applicant]
US 20130082922A1 · Miller · 2013 [cited by applicant]
US 20130117377A1 · Miller · 2013 [cited by applicant]
US 20130125027A1 · Abovitz · 2013 [cited by applicant]
US 20130208234A1 · Lewis · 2013 [cited by applicant]
US 20130235169A1 · Kato et al. · 2013 [cited by applicant]
US 20130242262A1 · Lewis · 2013 [cited by applicant]
US 20140071539A1 · Gao · 2014 [cited by applicant]
US 20140177023A1 · Gao et al. · 2014 [cited by applicant]
US 20140218468A1 · Gao et al. · 2014 [cited by applicant]
US 20140240842A1 · Nguyen et al. · 2014 [cited by applicant]
US 20140267420A1 · Schowengerdt et al. · 2014 [cited by applicant]
US 20140375540A1 · Ackerman et al. · 2014 [cited by applicant]
US 20150016777A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150103306A1 · Kaji et al. · 2015 [cited by applicant]
US 20150178939A1 · Bradski et al. · 2015 [cited by applicant]
US 20150193980A1 · Pedley et al. · 2015 [cited by applicant]
US 20150205126A1 · Schowengerdt · 2015 [cited by applicant]
US 20150309263A2 · Abovitz et al. · 2015 [cited by applicant]
US 20150326570A1 · Publicover et al. · 2015 [cited by applicant]
US 20150346495A1 · Welch et al. · 2015 [cited by applicant]
US 20160011419A1 · Gao · 2016 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160073092A1 · Lin et al. · 2016 [cited by applicant]
US 20160187651A1 · Border et al. · 2016 [cited by applicant]
US 20160353094A1 · Rougeaux · 2016 [cited by applicant]
US 20170000683A1 · Samec et al. · 2017 [cited by applicant]
US 20170124928A1 · Edwin et al. · 2017 [cited by applicant]
US 20170293145A1 · Miller et al. · 2017 [cited by applicant]
US 20180088328A1 · Wade · 2018 [cited by applicant]
US 20190220662A1 · Shenouda Dawoud · 2019 [cited by applicant]
US 20200209628A1 · Sztuk et al. · 2020 [cited by applicant]
US 20200310117A1 · Qian et al. · 2020 [cited by applicant]
US 20210181840A1 · Vlaskamp · 2021 [cited by applicant]
US 20220082739A1 · Franke et al. · 2022 [cited by applicant]
JP 2011221235A · 2011 [cited by applicant]
WO WO2012172719A1 · 2012 [cited by applicant]
WO WO2014017348A1 · 2014 [cited by applicant]
WO WO2018067357A2 · 2018 [cited by applicant]
WO WO2020023672A1 · 2020 [cited by applicant]
ARToolKit:https://web.archive.org/web/20051013062315/http:www.hitl.washington.edu:80/artoolkit/documentation/hardware.htm, archived Oct. 13, 2005. [cited by applicant]
Azuma, “A Survey of Augmented Reality,” [cited by applicant]
Azuma, “Predictive Tracking for Augmented Reality,” Dissertation, TR95-007, Doctor of Philosophy, Department of Computer Science, UNC-Chapel Hill, NC, Feb. 1995. (262 pages). [cited by applicant]
Bimber, et al., “Spatial Augmented Reality—Merging Real and Virtual Worlds,” 2005 <https://web.media.mit.edu/˜raskar/book/BimberRaskarAugmentedRealityBook.pdf>. [cited by applicant]
International Preliminary Report on Patentability, dated Jan. 26, 2021, for International Patent Application No. PCT/US2019/043302. (8 pages). [cited by applicant]
International Search Report and Written Opinion, dated Oct. 9, 2019, for International Patent Application No. PCT/US 19/43302. (9 pages). [cited by applicant]
Jacob, “Eye Tracking in Advanced Interface Design,” in Woodrow Barfield and Thomas A Furness III, Virtual Environments and Advanced Interface Design, Oxford Academic, https://doi.org/10.1093/oso/9780195075557.003.0015, … [cited by applicant]
Tanriverdi et al., “Interacting With Eye Movements in Virtual Environments,” ACM CHI 200 Human Factors in Computing Systems Conference, Tufts University, Medford, MA, 2000, pp. 265-272, Addison-Wesley/ACM Press, 2000. [cited by applicant]
Cited By (1)
US 12,524,186