IP Library Granted Patent US 10,849,817
Granted Patent B2
US 10,849,817 · App. 15/063,682 · Granted Dec 1, 2020

Providing enhanced images for navigation

Inventor: John N. Border (Eaton, NH)
Assignee: Mentor Acquisition One, LLC
A61H3/061G02B7/023G02B27/0172G02B27/0176G06F3/011G06F3/012G06F3/013G06F3/04815G06K9/00604G06K9/00671G06K9/2081G06K9/3258G06T3/40G06T5/003G06T5/009G06T11/60G09B21/008H04N5/23264H04N5/23293H04N5/23296H04N7/183H04N7/185A61H2003/063A61H2201/0188A61H2201/1604A61H2201/165A61H2201/501A61H2201/5043A61H2201/5048A61H2201/5058A61H2201/5061A61H2201/5064A61H2201/5071A61H2201/5082A61H2201/5084A61H2201/5092G02B2027/014G02B2027/0127G02B2027/0138G02B2027/0147G02B2027/0156G02B2027/0178G06T2207/20208G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,849,817
App. No.
15/063,682
Granted
Dec 1, 2020
Kind
B2
Abstract

Aspects of the present disclosure relate aids for the visually impaired.

Claims (33)

1. A method comprising:

capturing, via a camera of a wearable head device comprising a see-through display, an image comprising a surrounding environment of a user of the wearable head device;

enhancing a visibility of a first portion of the captured image corresponding to a first portion of the surrounding environment;

forgoing enhancing a visibility of a second portion of the captured image corresponding to a second portion of the surrounding environment; and

presenting, concurrently via the see-through display of the wearable head device, the enhanced first portion of the captured image and a see-through view of the second portion of the surrounding environment,

wherein presenting the enhanced first portion comprises presenting the enhanced first portion at a region of the see-through display determined based on a position of an eye of the user relative to a field of view of the see-through display.

2. The method of claim 1 , wherein enhancing a visibility of a first portion of the captured image comprises increasing a contrast of the first portion of the captured image.

3. The method of claim 1 , wherein enhancing a visibility of a first portion of the captured image comprises increasing a brightness of the first portion of the captured image.

4. The method of claim 1 , wherein enhancing a visibility of a first portion of the captured image comprises increasing a sharpness of the first portion of the captured image.

5. The method of claim 1 , wherein enhancing a visibility of a first portion of the captured image comprises increasing a color saturation of the first portion of the captured image.

6. The method of claim 1 , wherein the method is performed repeatedly as the user navigates in the surrounding environment.

7. The method of claim 1 , wherein enhancing a visibility of a first portion of the captured image comprises changing a focus distance of the first portion of the captured image.

8. The method of claim 7 , wherein the focus distance is determined based on an ophthalmic characteristic of the eye.

9. The method of claim 1 , wherein enhancing a visibility of a first portion of the enhanced image comprises adjusting one or more digital code values corresponding to one or more pixels of the first portion of the captured image.

10. The method of claim 9 , wherein enhancing the visibility of the first portion of the enhanced image further comprises increasing code values that exceed a predetermined threshold and decreasing code values that do not exceed the predetermined threshold.

11. The method of claim 9 , wherein enhancing the visibility of the first portion of the enhanced image further comprises increasing luma for pixels that have luma values above a predetermined threshold and decreasing luma for pixels that have luma values below the predetermined threshold.

12. The method of claim 11 , wherein increasing or decreasing luma comprises applying a scale factor to the one or more digital code values associated with the pixels.

13. The method of claim 10 , wherein the predetermined threshold comprises a value between 35% and 60% of a maximum code value.

14. A wearable head device comprising:

a see-through display;

a camera; and

one or more processors configured to perform a method comprising:

capturing, via the camera, an image comprising a surrounding environment of a user of the wearable head device;

enhancing a visibility of a first portion of the captured image corresponding to a first portion of the surrounding environment;

forgoing enhancing a visibility of a second portion of the captured image corresponding to a second portion of the surrounding environment; and

presenting, concurrently via the see-through display, the enhanced first portion of the captured image and a see-through view of the second portion of the surrounding environment,

wherein presenting the enhanced first portion comprises presenting the enhanced first portion at a region of the see-through display determined based on a position of an eye of the user relative to a field of view of the see-through display.

15. The wearable head device of claim 14 , wherein enhancing a visibility of a first portion of the captured image comprises increasing a contrast of the first portion of the captured image.

16. The wearable head device of claim 14 , wherein enhancing a visibility of a first portion of the captured image comprises increasing a brightness of the first portion of the captured image.

17. The wearable head device of claim 14 , wherein enhancing a visibility of a first portion of the captured image comprises increasing a color saturation of the first portion of the captured image.

18. The wearable head device of claim 14 , wherein enhancing a visibility of a first portion of the captured image comprises increasing a sharpness of the first portion of the captured image.

19. The wearable head device of claim 14 , wherein enhancing a visibility of a first portion of the captured image comprises changing a focus distance of the first portion of the captured image.

20. The wearable head device of claim 19 , wherein the focus distance is determined based on an ophthalmic characteristic of the eye.

Assignments (9)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →
ASSIGNMENT OF PATENTS AND PATENT APPLICATIONS Recorded Apr 18, 2019
From: JGB COLLATERAL, LLC
To: MENTOR ACQUISITION ONE, LLC
Reel/Frame 048945/0939 →
SECURED PARTY BILL OF SALE Recorded Apr 18, 2019
From: OSTERHOUT GROUP, INC.
To: JGB COLLATERAL, LLC
Reel/Frame 051018/0883 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 24, 2018
From: BORDER, JOHN N.
To: OSTERHOUT GROUP, INC.
Reel/Frame 047288/0631 →
SECURITY INTEREST Recorded Mar 15, 2018
From: OSTERHOUT GROUP, INC.
To: JGB COLLATERAL, LLC
Reel/Frame 045606/0295 →
SECURITY INTEREST Recorded Oct 3, 2017
From: OSTERHOUT GROUP, INC.
To: O-FILM GLOBAL (HK) TRADING LIMITED
Reel/Frame 044127/0501 →
SECURITY INTEREST Recorded Sep 28, 2017
From: OSTERHOUT GROUP, INC.
To: 21ST CENTURY FOX AMERICA, INC.
Reel/Frame 044052/0367 →
Cited By (1)
US 12,702,615