Granted Patent B2

US 12,196,952 · App. 18/521,613 · Granted Jan 14, 2025

Inventors: Lionel Ernest Edwin (Hollywood, FL); Zachary C. Nienstedt (Fort Lauderdale, FL); Ivan Li Chuen Yeoh (Wesley Chapel, FL); Samuel A. Miller (Hollywood, FL); Yan Xu (San Jose, CA); Jordan Alexander Cazamias (Menlo Park, CA)

Assignee: Magic Leap, Inc.

G02B27/0081A61B3/111A61B3/113G02B27/0093G02B27/0172G02B27/0176G02B30/00G02B30/40G06F1/163G06F3/011G06F3/012G06F3/013G06F3/017G06F3/0346G06F3/04815G06F3/16G06F3/167G06V40/193H04N13/344H04N13/383G02B2027/0134G02B2027/0138G02B2027/0174G06T3/40G06V10/42G06V10/467G06V10/60

Abstract

Claims (40)

1. A display system configured to project light to an eye of a user to display virtual image content, the display system comprising:

a frame configured to be supported on a head of the user;

a head-mounted display disposed on the frame, the display configured to project light into the eye to display virtual image content with different amounts of wavefront divergence to present virtual image content appearing to be located at different depths;

one or more eye-tracking cameras configured to image the eye; and

processing electronics in communication with the display and the one or more eye-tracking cameras, the processing electronics configured to:

define a display registration volume relative to the display, wherein the display registration volume is a three-dimensional (3D) volume of space that is defined with reference to the display such that the virtual image content is received by the eye while the eye is situated within the display registration volume, and such that the virtual image content is not received by the eye, or the virtual image content is dimmed, while the eye is not situated within the display registration volume, and wherein the display registration volume is a tapered 3D volume of space such that an area of a cross-section of the display registration volume decreases with increasing distance from the display;

determine a position of the eye based on one or more images of the eye obtained with the one or more eye-tracking cameras;

determine whether the position of the eye is within the display registration volume;

control operation of the display based on determining whether the position of the eye is within the display registration volume;

define a housing registration volume relative to one or more openings in the frame, wherein the housing registration volume is a second 3D volume of space that is defined such that an external field of view of an external environment proximal to the display is viewable by the eye while the eye is situated within the housing registration volume;

determine whether the position of the eye is within the housing registration volume; and

provide, to the user, a notification of misregistration based on determining that the eye is not within the housing registration volume.

2. The display system of claim 1 , wherein the processing electronics are further configured to provide, to the user, the notification of misregistration based on determining that the eye is not within the display registration volume.

3. The display system of claim 1 , wherein the display registration volume is shaped as a frustum.

4. The display system of claim 1 , wherein the housing registration volume is shaped as a truncated cone.

5. The display system of claim 1 , wherein the processing electronics are further configured to provide the notification of misregistration based on determining that the eye is outside both the display registration volume and the housing registration volume.

6. The display system of claim 1 , wherein the processing electronics are further configured to:

define a combined registration volume that includes points in the 3D volume of space that are in both the display registration volume and the housing registration volume;

determine whether the position of the eye is within the combined registration volume; and

provide, to the user, the notification of misregistration based on determining that the eye is not within the combined registration volume.

7. The display system of claim 1 , wherein the display registration volume is defined based on one or more parameters that comprise a type of application that is running on the display system.

8. The display system of claim 1 , wherein the display registration volume is defined based on one or more parameters that comprise one or more physical parameters of the head-mounted display.

9. The display system of claim 8 , wherein the one or more physical parameters of the head-mounted display comprise one or more of a dimension of a field of view of the display, a surface size of the display, a shape of the display, a dimension of an outer housing of the display, or an amount of optical power imparted by the display to light representing virtual image content.

10. The display system of claim 1 , wherein the processing electronics are further configured to control operation of the display by presenting virtual image content to the user indicating at least that the display and the eye are not properly registered, based on determining that the position of the eye is not within the display registration volume.

11. A computer-implemented method for controlling a head-mountable display configured to project light to an eye of a user to display virtual image content, the method comprising:

defining a display registration volume relative to the display, wherein the display registration volume is a three-dimensional (3D) volume of space that is defined with reference to the display such that the virtual image content is received by the eye while the eye is situated within the display registration volume, and such that the virtual image content is not received by the eye, or the virtual image content is dimmed, while the eye is not situated within the display registration volume, and wherein the display registration volume is a tapered 3D volume of space such that an area of a cross-section of the display registration volume decreases with increasing distance from the display;

determining a position of the eye based on one or more images of the eye;

determining whether the position of the eye is within the display registration volume;

controlling operation of the display based on determining whether the position of the eye is within the display registration volume;

defining a housing registration volume relative to one or more openings in a frame of the display, wherein the housing registration volume is a second 3D volume of space that is defined such that an external field of view of an external environment proximal to the display is viewable by the eye while the eye is situated within the housing registration volume;

determining whether the position of the eye is within the housing registration volume; and

providing, to the user, a notification of misregistration based on determining that the eye is not within the housing registration volume.

12. The method of claim 11 , further comprising providing, to the user, the notification of misregistration based on determining that the eye is not within the display registration volume.

13. The method of claim 11 , wherein the display registration volume is shaped as a frustum.

14. The method of claim 11 , wherein the housing registration volume is shaped as a truncated cone.

15. The method of claim 11 , further comprising providing the notification of misregistration based on determining that the eye is outside both the display registration volume and the housing registration volume.

16. The method of claim 11 , further comprising:

defining a combined registration volume that includes points in the 3D volume of space that are in both the display registration volume and the housing registration volume;

determining whether the position of the eye is within the combined registration volume; and

providing, to the user, the notification of misregistration based on determining that the eye is not within the combined registration volume.

Assignments (3)

Continuity (7)

References Cited (218)