IP Library › Granted Patent US 12,266,064
Granted Patent B2
US 12,266,064 · App. 18/391,467 · Granted Apr 1, 2025

Modification of peripheral content in world-locked see-through computer display systems

Inventors: John D. Haddick (Corte Madera, CA); Ralph F. Osterhout (San Francisco, CA)
Assignee: Mentor Acquisition One, LLC
G06T19/006G02B5/30G02B27/017G02B27/0172G06F1/163G06F3/013G06F5/10G06T19/20G09G3/3208G09G3/3225G09G3/3233G02B3/0006G02B2027/0118G02B2027/0123G02B2027/0138G02B2027/014G02B2027/0147G02B2027/0178G09G2340/0471G09G2340/0478
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,266,064
App. No.
18/391,467
Filed
Dec 20, 2023
Granted
Apr 1, 2025
Kind
B2
Art Unit
2626
USPC
345/8
Abstract

Aspects of the present invention relate to methods and systems for the see-through computer display systems with an extended field of view.

Claims (56)

1. A wearable device comprising:

a display having an edge region corresponding to an edge of a field of view and a center region corresponding to a center of the field of view;

one or more eye-imaging components configured to detect a position of an eye of a user of the wearable device;

a camera configured to capture an image of an environment of the user;

a processor configured to present image content to the user via the display concurrently with presenting a view of the environment of the user, wherein a position of the image content in the field of view is dependent upon a position in the environment, and wherein said presenting the image content comprises:

in accordance with a determination that presenting the image content comprises presenting the image content in the center region of the display, presenting the image content with a first visibility;

in accordance with a determination that presenting the image content comprises presenting the image content in the edge region of the display, presenting the image content with a second visibility, the second visibility different from the first visibility; and

adjusting a position of the edge region relative to the center region based on the detected position of the eye of the user; and

one or more optical components configured to project the image content in the center region and further configured to project the image content in the edge region, the position of the edge region adjusted relative to the center region based on the detected position of the eye of the user.

2. The wearable device of claim 1 , wherein said presenting the image content further comprises:

in accordance with a determination that presenting the image content comprises presenting the image content in the center region of the display, presenting the image content with a first brightness;

in accordance with a determination that presenting the image content comprises presenting the image content in the edge region of the display, presenting the image content with a second brightness, the second brightness lower than the first brightness.

3. The wearable device of claim 1 , wherein said presenting the image content further comprises:

in accordance with a determination that presenting the image content comprises presenting the image content in the center region of the display, presenting the image content with a first resolution;

in accordance with a determination that presenting the image content comprises presenting the image content in the edge region of the display, presenting the image content with a second resolution, the second resolution lower than the first resolution.

4. The wearable device of claim 1 , wherein said presenting the image content further comprises:

in accordance with a determination that presenting the image content comprises presenting the image content in the center region of the display, presenting the image content with a first contrast;

in accordance with a determination that presenting the image content comprises presenting the image content in the edge region of the display, presenting the image content with a second contrast, the second contrast lower than the first contrast.

5. The wearable device of claim 1 , wherein said presenting the image content further comprises:

in accordance with a determination that presenting the image content comprises presenting the image content in the center region of the display, presenting the image content with a first focus;

in accordance with a determination that presenting the image content comprises presenting the image content in the edge region of the display, presenting the image content with a second focus, the second focus lower than the first focus.

6. The wearable device of claim 1 , wherein said presenting the image content further comprises:

in accordance with a determination that presenting the image content comprises presenting the image content in the center region of the display, presenting the image content with a first sharpness;

in accordance with a determination that presenting the image content comprises presenting the image content in the edge region of the display, presenting the image content with a second sharpness, the second sharpness lower than the first sharpness.

7. The wearable device of claim 1 , wherein the display comprises a see-through panel.

8. The wearable device of claim 1 , wherein the display comprises:

a first panel comprising the center region; and

a second panel comprising the edge region.

9. The wearable device of claim 1 , wherein the center region comprises a field of view of approximately 60 degrees.

10. A method comprising:

capturing an image of an environment of a user of a wearable device via a camera of the wearable device,

presenting image content to the user via a display of the wearable device concurrently with presenting a view of the environment of the user, wherein the display comprises an edge region corresponding to an edge of a field of view and a center region corresponding to a center of the field of view and wherein a position of the image content in the field of view is dependent upon a position in the environment;

detecting a position of an eye of the user via an eye-imaging component of the wearable device; and

adjusting a position of the edge region relative to the center region based on the detected position of the eye of the user;

wherein said presenting the image content comprises:

in accordance with a determination that presenting the image content comprises presenting the image content in the center region of the display, presenting the image content with a first visibility;

in accordance with a determination that presenting the image content comprises presenting the image content in the edge region of the display, presenting the image content with a second visibility, the second visibility lower than the first visibility;

wherein the wearable device further comprises one or more optical components configured to project the image content in the center region and further configured to project the image content in the edge region, the position of the edge region adjusted relative to the center region based on the detected position of the eye of the user.

11. The method of claim 10 , wherein the first visibility is based on a first brightness of the image content, and the second visibility is based on a second brightness of the image content.

12. The method of claim 10 , wherein the first visibility is based on a first resolution of the image content, and the second visibility is based on a second resolution of the image content.

13. The method of claim 11 , wherein the first visibility is based on a first contrast of the image content, and the second visibility is based on a second contrast of the image content.

14. The method of claim 10 , wherein the first visibility is based on a first focus of the image content, and the second visibility is based on a second focus of the image content.

15. The method of claim 10 , wherein the first visibility is based on a first sharpness of the image content, and the second visibility is based on a second sharpness of the image content.

16. The method of claim 11 , wherein the display comprises a see-through panel.

17. The method of claim 10 , wherein the display comprises:

a first panel comprising the center region; and

a second panel comprising the edge region.

18. A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:

capturing an image of an environment of a user of a wearable device via a camera of the wearable device,

presenting image content to the user via a display of the wearable device concurrently with presenting a view of the environment of the user, wherein the display comprises an edge region corresponding to an edge of a field of view and a center region corresponding to a center of the field of view, and wherein a position of the image content in the field of view is dependent upon a position in the environment;

detecting a position of an eye of the user via an eye-imaging component of the wearable device; and

adjusting a position of the edge region relative to the center region based on the detected position of the eye of the user;

wherein said presenting the image content comprises:

in accordance with a determination that presenting the image content comprises presenting the image content in the center region of the display, presenting the image content with a first visibility;

in accordance with a determination that presenting the image content comprises presenting the image content in the edge region of the display, presenting the image content with a second visibility, the second visibility lower than the first visibility;

wherein the wearable device further comprises one or more optical components configured to project the image content in the center region and further configured to project the image content in the edge region, the position of the edge region adjusted relative to the center region based on the detected position of the eye of the user.

Assignments (3)
SECURITY INTEREST Recorded Oct 31, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073422/0549 →
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2025
From: OSTERHOUT, RALPH F.; BORDER, JOHN N.; NORTRUP, EDWARD H.
To: OSTERHOUT GROUP, INC.
Reel/Frame 072525/0401 →
Continuity (7)
Continuation 17842665 · Jun 16, 2022
Continuation 17468494 · Sep 7, 2021
Continuation 16826034 · Mar 20, 2020
Continuation 14741943 · Jun 17, 2015
Continuation 14742514 · Jun 17, 2015
Continuation In Part 14163646 · Jan 24, 2014
Related Publication 20240127553A1 · Apr 18, 2024
References Cited (63)
US 4852988A · Velez · 1989 [cited by applicant]
US 6433760B1 · Vaissie · 2002 [cited by applicant]
US 6491391B1 · Blum et al. · 2002 [cited by applicant]
US 6847336B1 · Lemelson · 2005 [cited by applicant]
US 6943754B2 · Aughey · 2005 [cited by applicant]
US 6977776B2 · Volkenandt et al. · 2005 [cited by applicant]
US 7347551B2 · Fergason et al. · 2008 [cited by applicant]
US 7488294B2 · Torch · 2009 [cited by applicant]
US 8235529B1 · Raffle · 2012 [cited by applicant]
US 8611015B2 · Wheeler · 2013 [cited by applicant]
US 8638498B2 · Bohn et al. · 2014 [cited by applicant]
US 8696113B2 · Lewis · 2014 [cited by applicant]
US 8929589B2 · Publicover et al. · 2015 [cited by applicant]
US 9010929B2 · Lewis · 2015 [cited by applicant]
US 9274338B2 · Robbins et al. · 2016 [cited by applicant]
US 9292973B2 · Bar-zeev et al. · 2016 [cited by applicant]
US 9323325B2 · Perez et al. · 2016 [cited by applicant]
US 9442291B1 · Martinez · 2016 [cited by examiner]
US 9720505B2 · Gribetz et al. · 2017 [cited by applicant]
US 10013053B2 · Cederlund et al. · 2018 [cited by applicant]
US 10025379B2 · Drake et al. · 2018 [cited by applicant]
US 11145132B2 · Haddick · 2021 [cited by examiner]
US 11443493B2 · Haddick · 2022 [cited by examiner]
US 11900554B2 · Haddick · 2024 [cited by examiner]
US 20030030597A1 · Geist · 2003 [cited by applicant]
US 20060023158A1 · Howell et al. · 2006 [cited by applicant]
US 20080247048A1 · Francois · 2008 [cited by examiner]
US 20110211056A1 · Publicover et al. · 2011 [cited by applicant]
US 20110213664A1 · Osterhout · 2011 [cited by applicant]
US 20120021806A1 · Maltz · 2012 [cited by applicant]
US 20130077147A1 · Efimov · 2013 [cited by applicant]
US 20130169530A1 · Bhaskar · 2013 [cited by examiner]
US 20140195918A1 · Friedlander · 2014 [cited by applicant]
US 20140232651A1 · Kress · 2014 [cited by examiner]
US 20140375683A1 · Salter · 2014 [cited by examiner]
US 20150147000A1 · Salvador Marcos · 2015 [cited by examiner]
US 20150168731A1 · Robbins · 2015 [cited by applicant]
US 20150260887A1 · Salisbury · 2015 [cited by examiner]
US 20150331485A1 · Wilairat · 2015 [cited by examiner]
US 20150381974A1 · Hoffman · 2015 [cited by examiner]
US 20160035139A1 · Fuchs · 2016 [cited by examiner]
US 20160055675A1 · Kasahara · 2016 [cited by examiner]
US 20160062636A1 · Jung · 2016 [cited by examiner]
US 20160109943A1 · Larson · 2016 [cited by examiner]
US 20160131908A1 · Fateh · 2016 [cited by examiner]
US 20160238845A1 · Alexander · 2016 [cited by examiner]
US 20160240013A1 · Spitzer · 2016 [cited by examiner]
US 20160266386A1 · Scott · 2016 [cited by examiner]
US 20160274365A1 · Bailey · 2016 [cited by examiner]
CA 2316473A1 · 2001 [cited by applicant]
CA 2362895A1 · 2002 [cited by applicant]
CA 2388766A1 · 2003 [cited by applicant]
Final Office Action mailed Mar. 31, 2023, for U.S. Appl. No. 17/842,665, filed Jun. 16, 2022, eighteen pages. [cited by applicant]
Jacob, R. “Eye Tracking in Advanced Interface Design”, Virtual Environments and Advanced Interface Design, Oxford University Press, Inc. (Jun. 1995). [cited by applicant]
Non-Final Office Action mailed Feb. 5, 2021, for U.S. Appl. No. 16/826,034, filed Mar. 20, 2020, 23 pages. [cited by applicant]
Non-Final Office Action mailed Nov. 17, 2022, for U.S. Appl. No. 17/842,665, filed Jun. 16, 2022, twenty-one pages. [cited by applicant]
Notice of Allowance mailed Jun. 7, 2021, for U.S. Appl. No. 16/826,034, filed Mar. 20, 2020, nine pages. [cited by applicant]
Notice of Allowance mailed May 3, 2022, for U.S. Appl. No. 17/468,494, filed Sep. 7, 2021, eight pages. [cited by applicant]
Notice of Allowance mailed Nov. 20, 2023, for U.S. Appl. No. 17/842,665, filed Jun. 16, 2022, eight pages. [cited by applicant]
Notice of Allowance mailed Sep. 19, 2023, for U.S. Appl. No. 17/842,665, filed Jun. 16, 2022, eight pages. [cited by applicant]
Rolland, J. et al., “High-resolution inset head-mounted display”, Optical Society of America, vol. 37, No. 19, Applied Optics, (Jul. 1, 1998). [cited by applicant]
Tanriverdi, V. et al. (Apr. 2000). “Interacting With Eye Movements In Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA 02155, USA, Proceedings of the SIGCHI… [cited by applicant]
Yoshida, A. et al., “Design and Applications of a High Resolution Insert Head Mounted Display”, (Jun. 1994). [cited by applicant]
Cited By (1)
US 12,608,667