IP Library Granted Patent US 12,171,713
Granted Patent B2
US 12,171,713 · App. 18/301,137 · Granted Dec 24, 2024

Providing enhanced images for navigation

Inventor: John N. Border (Eaton, NH)
Assignee: Mentor Acquisition One, LLC
A61H3/061G02B7/023G02B27/0172G02B27/0176G06F3/011G06F3/012G06F3/013G06F3/04815G06T3/40G06T5/73G06T5/92G06T11/60G06V10/235G06V20/20G06V20/63G06V40/19G09B21/008H04N7/183H04N7/185H04N23/63H04N23/682H04N23/69A61H2003/063A61H2201/0188A61H2201/1604A61H2201/165A61H2201/501A61H2201/5043A61H2201/5048A61H2201/5058A61H2201/5061A61H2201/5064A61H2201/5071A61H2201/5082A61H2201/5084A61H2201/5092G02B2027/0127G02B2027/0138G02B2027/014G02B2027/0147G02B2027/0156G02B2027/0178G06T2207/20208G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,171,713
App. No.
18/301,137
Filed
Apr 14, 2023
Granted
Dec 24, 2024
Kind
B2
Art Unit
2485
USPC
348/62
Abstract

Systems and methods relating to displaying images are disclosed. In one embodiment, sensor data is received via one or more sensors of a wearable head device comprising a display, the sensor data indicative of a surrounding environment of a user of the wearable head device. An image can be determined based on the sensor data, the image corresponding to the surrounding environment. A visibility of a first portion of the image corresponding to a first portion of the surrounding environment can be enhanced. Enhancing a visibility of a second portion of the image corresponding to a second portion of the surrounding environment can be forgone. The enhanced first portion of the image and a view of the second portion of the surrounding environment can be presented concurrently via the display of the wearable head device.

Claims (58)

1. A method comprising:

receiving, via one or more sensors of a wearable head device comprising a display, sensor data indicative of a surrounding environment of a user of the wearable head device;

determining an image based on the sensor data, the image corresponding to the surrounding environment;

presenting, to the user via the display, a view comprising the image;

enhancing a visibility of a first portion of the view associated with a first portion of the surrounding environment; and

forgoing enhancing a visibility of a second portion of the view associated with a second portion of the surrounding environment;

wherein presenting the view to the user via the display comprises presenting the enhanced first portion of the view at a region of the display determined based on a position of an eye of the user relative to a field of view of the display.

2. The method of claim 1 , wherein:

the display is a non-see-through display, and

the one or more sensors comprises one or more of a camera, an ultrasonic sensor, and a radar sensor.

3. The method of claim 1 , further comprising:

receiving head tracking data; and

determining the position of the eye of the user relative to the field of view of the display based on the head tracking data.

4. The method of claim 1 , further comprising:

receiving gesture data; and

determining the position of the eye of the user relative to the field of view of the display based on the gesture data.

5. The method of claim 1 , wherein enhancing a visibility of a first portion of the view comprises increasing one or more of a magnification of the first portion of the view, a stabilization of the first portion of the view, a contrast of the first portion of the view, a brightness of the first portion of the view, a sharpness of the first portion of the view, and a color saturation of the first portion of the view.

6. The method of claim 1 , wherein enhancing a visibility of a first portion of the view comprises changing a field of view of the first portion of the view.

7. The method of claim 1 , wherein enhancing a visibility of a first portion of the view comprises presenting a graphical representation of a word in the first portion of the view.

8. A wearable system comprising:

a wearable head device comprising a display and one or more sensors; and

one or more processors configured to perform a method comprising:

receiving, via the one or more sensors, sensor data indicative of a surrounding environment of a user of the wearable head device;

determining an image based on the sensor data, the image corresponding to the surrounding environment;

presenting, to the user via the display, a view comprising the image;

enhancing a visibility of a first portion of the view associated with a first portion of the surrounding environment; and

forgoing enhancing a visibility of a second portion of the view associated with a second portion of the surrounding environment;

wherein presenting the view to the user via the display comprises presenting the enhanced first portion of the view at a region of the display determined based on a position of an eye of the user relative to a field of view of the display.

9. The wearable system of claim 8 , wherein:

the display is a non-see-through display, and

the one or more sensors comprises one or more of a camera, an ultrasonic sensor, and a radar sensor.

10. The wearable system of claim 8 , the method further comprising:

receiving head tracking data; and

determining the position of the eye of the user relative to the field of view of the display based on the head tracking data.

11. The wearable system of claim 8 , the method further comprising:

receiving gesture data; and

determining the position of the eye of the user relative to the field of view of the display based on the gesture data.

12. The wearable system of claim 8 , wherein enhancing a visibility of a first portion of the view comprises increasing one or more of a magnification of the first portion of the view, a stabilization of the first portion of the view, a contrast of the first portion of the view, a brightness of the first portion of the view, a sharpness of the first portion of the view, and a color saturation of the first portion of the view.

13. The wearable system of claim 8 , wherein enhancing a visibility of a first portion of the view comprises changing a field of view of the first portion of the view.

14. The wearable system of claim 8 , wherein enhancing a visibility of a first portion of the view comprises presenting a graphical representation of a word in the first portion of the view.

15. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:

receiving, via one or more sensors of a wearable head device comprising a display, sensor data indicative of a surrounding environment of a user of the wearable head device;

determining an image based on the sensor data, the image corresponding to the surrounding environment;

presenting, to the user via the display, a view comprising the image;

enhancing a visibility of a first portion of the view associated with a first portion of the surrounding environment; and

forgoing enhancing a visibility of a second portion of the view associated with a second portion of the surrounding environment;

wherein presenting the view to the user via the display comprises presenting the enhanced first portion of the view at a region of the display determined based on a position of an eye of the user relative to a field of view of the display.

16. The non-transitory computer-readable medium of claim 15 , wherein:

the display is a non-see-through display, and

the one or more sensors comprises one or more of a camera, an ultrasonic sensor, and a radar sensor.

17. The non-transitory computer-readable medium of claim 15 , the method further comprising:

receiving head tracking data; and

determining the position of the eye of the user relative to the field of view of the display based on the head tracking data.

18. The non-transitory computer-readable medium of claim 15 , the method further comprising:

receiving gesture data; and

determining the position of the eye of the user relative to the field of view of the display based on the gesture data.

19. The non-transitory computer-readable medium of claim 15 , wherein enhancing a visibility of a first portion of the view comprises increasing one or more of a magnification of the first portion of the view, a stabilization of the first portion of the view, a contrast of the first portion of the view, a brightness of the first portion of the view, a sharpness of the first portion of the view, and a color saturation of the first portion of the view.

20. The non-transitory computer-readable medium of claim 15 , wherein enhancing a visibility of a first portion of the view comprises changing a field of view of the first portion of the view.

Assignments (5)
SECURED PARTY BILL OF SALE Recorded Nov 20, 2025
From: OSTERHOUT GROUP, INC.
To: JGB COLLATERAL, LLC
Reel/Frame 073641/0775 →
ENTITY TO ENTITY ASSIGNMENT Recorded Nov 19, 2025
From: JGB COLLATERAL, LLC
To: MENTOR ACQUISITION ONE, LLC
Reel/Frame 073604/0826 →
SECURITY INTEREST Recorded Oct 29, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073438/0463 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 24, 2025
From: OSTERHOUT, RALPH F.; BORDER, JOHN N.; HADDICK, JOHN D.; RIEHLE, ED
To: OSTERHOUT GROUP, INC.
Reel/Frame 072671/0513 →
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0238 →
Continuity (5)
Continuation 17684302 · Mar 1, 2022
Continuation 17077980 · Oct 22, 2020
Continuation 15063682 · Mar 8, 2016
Continuation 15056573 · Feb 29, 2016
Related Publication 20230270619A1 · Aug 31, 2023
Cited By (1)
US 12,702,615