Granted Patent B2

US 12,393,030 · App. 18/145,800 · Granted Aug 19, 2025

Inventors: Ralph F. Osterhout (San Francisco, CA); Robert Michael Lohse (Palo Alto, CA)

Assignee: Mentor Acquisition One, LLC

G02B27/0172G02B27/0093G02B27/0176H04N13/239H04N13/296H04N13/344H04N13/383H04N23/20H04N23/60H04N23/69H04N23/90G02B27/0075G02B27/0101G02B27/017G03B37/04G06F1/163G06F3/005H04N5/2628H04N9/317H04N23/698

Abstract

Claims (72)

1. A system comprising:

a wearable head device comprising:

a transmissive display configured to present a first field of view, the first field of view comprising a first region having a first display resolution, and

one or more sensors; and

one or more processors in communication with the wearable head device, the one or more processors configured to:

determine, via the one or more sensors, an eye position of a user of the wearable head device,

determine, via the one or more sensors, a convergence of a left eye and a right eye of the user of the wearable head device,

determine, based on the convergence of the left eye and the right eye, a focal plane,

output an image having a second field of view different from the first field of view, the second field of view comprising a second region having a second display resolution different from the first display resolution, wherein a location and a size of the second region in the second field of view are adjusted based on the eye position and the focal plane,

adjust a first zoom level, wherein the transmissive display is further configured to present the second region of the second field of view, concurrently with presenting the first region of the first field of view,

predict, based on the eye position, that content presented in the first region in the first display resolution will move to the second region, and

in accordance with the prediction that the content presented in the first region will move to the second region, update a resolution of the content, the updated resolution of the content between the first display resolution and the second display resolution.

2. The system of claim 1 , wherein:

the one or more processors are further configured to output a stereo image of the second field of view, and

the presenting the second region comprises presenting the stereo image.

3. The system of claim 2 , wherein the transmissive display comprises a left eye display and a right eye display,

wherein:

the one or more processors are further configured to output a left eye component of the stereo image and a right eye component of the stereo image,

the left eye display is configured to present the left eye component to a left eye, and

the right eye display is configured to present the right eye component to a right eye.

4. The system of claim 2 , wherein the one or more processors are further configured to output a second image having a third field of view different from the second field of view.

5. The system of claim 4 , wherein the transmissive display is further configured to present at least a portion of the second image, concurrently with presenting the first region of the first field of view.

6. The system of claim 1 , wherein the second field of view is wider than the first field of view.

7. The system of claim 1 , wherein the second field of view is narrower than the first field of view.

8. The system of claim 1 , wherein the one or more sensors comprise an inertial measurement unit, a GPS sensor, an accelerometer, or any combination thereof.

9. The system of claim 1 , wherein the determining the convergence of the left eye and the right eye comprises:

determining, based on an image of the left eye and the right eye, a virtual target line of the left eye and a virtual target line of the right eye, wherein the image of the left eye and the right eye is obtained via the one or more sensors, and

determining a convergence of the virtual target line of the left eye and the virtual target line of the right eye.

10. The system of claim 1 , wherein the focal plane is determined based on a calibration, the calibration comprising corresponding a plurality of second focal planes to a plurality of second eye convergences.

11. A method comprising:

presenting, via a transmissive display of a wearable head device, a first field of view comprising a first region having a first display resolution;

determining, via one or more sensors of the wearable head device, an eye position of a user of the wearable head device;

determining, via the one or more sensors, a convergence of a left eye and a right eye of the user of the wearable head device;

determining, based on the convergence of the left eye and the right eye, a focal plane;

outputting, via one or more processors in communication with the wearable head device, an image having a second field of view different from the first field of view, the second field of view comprising a second region having a second display resolution different from the first display resolution, wherein a location and a size of the second region in the second field of view are adjusted based on the eye position and the focal plane;

adjusting a first zoom level;

presenting, via the transmissive display, concurrently with presenting the first region of the first field of view, the second region of the second field of view;

predicting, based on the eye position, that content presented in the first region in the first display resolution will move to the second region, and

in accordance with the prediction that the content presented in the first region will move to the second region, updating a resolution of the content, the updated resolution of the content between the first display resolution and the second display resolution.

12. The method of claim 11 , further comprising:

outputting, via the one or more processors, a stereo image of the second field of view, wherein the presenting the second region comprises presenting the stereo image.

13. The method of claim 12 , wherein the transmissive display comprises a left eye display and a right eye display, and wherein the method further comprises:

outputting, via the one or more processors, a left eye component of the stereo image,

outputting, via the one or more processors, a right eye component of the stereo image,

presenting, via the left eye display, the left eye component to a left eye, and

presenting, via the right eye display, the right eye component to a right eye.

14. The method of claim 12 , further comprising:

outputting, via the one or more processors, a second image having a third field of view different from the second field of view.

15. The method of claim 14 , further comprising presenting, via the transmissive display, concurrently with presenting the first region of the first field of view, at least a portion of the second image.

16. The method of claim 11 , wherein the second field of view is wider than the first field of view.

17. The method of claim 11 , wherein the second field of view is narrower than the first field of view.

18. A non-transitory computer-readable medium comprising instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:

presenting, via a transmissive display of a wearable head device, a first field of view comprising a first region having a first display resolution;

determining, via one or more sensors of the wearable head device, an eye position of a user of the wearable head device;

determining, via the one or more sensors, a convergence of a left eye and a right eye of the user of the wearable head device;

determining, based on the convergence of the left eye and the right eye, a focal plane;

outputting an image having a second field of view different from the first field of view, the second field of view comprising a second region having a second display resolution different from the first display resolution, wherein a location and a size of the second region in the second field of view are adjusted based on the eye position and the focal plane;

adjusting a first zoom level;

presenting, via the transmissive display, concurrently with presenting the first region of the first field of view, the second region of the second field of view;

predicting, based on the eye position, that content presented in the first region in the first display resolution will move to the second region, and

in accordance with the prediction that the content presented in the first region will move to the second region, updating a resolution of the content, the updated resolution of the content between the first display resolution and the second display resolution.

19. The non-transitory computer-readable medium of claim 18 , the method further comprising:

outputting a stereo image of the second field of view, wherein the presenting the second region comprises presenting the stereo image.

20. The non-transitory computer-readable medium of claim 19 , wherein the transmissive display comprises a left eye display and a right eye display, and wherein the method further comprises:

outputting a left eye component of the stereo image,

outputting a right eye component of the stereo image,

presenting, via the left eye display, the left eye component to a left eye, and

presenting, via the right eye display, the right eye component to a right eye.

21. The non-transitory computer-readable medium of claim 19 , the method further comprising:

outputting a second image having a third field of view different from the second field of view.

22. The non-transitory computer-readable medium of claim 21 , the method further comprising presenting, via the transmissive display, concurrently with presenting the first region of the first field of view, at least a portion of the second image.

23. The non-transitory computer-readable medium of claim 18 , wherein the second field of view is wider than the first field of view.

Assignments (5)

Continuity (4)

References Cited (400)