IP Library Granted Patent US 10,591,728
Granted Patent B2
US 10,591,728 · App. 15/058,383 · Granted Mar 17, 2020

Optical systems for head-worn computers

Inventors: Nima L. Shams (San Jose, CA); John N. Border (Eaton, NH); John D. Haddick (Mill Valley, CA)
Assignee: MENTOR ACQUISITION ONE, LLC
G02B27/017G02B27/0093G06F1/163G06F3/011G06F3/012G06F3/013G06F3/0346G06T3/0006G06T3/4015G06T7/73G02B2027/013G02B2027/0114G02B2027/0118G02B2027/0174G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,591,728
App. No.
15/058,383
Granted
Mar 17, 2020
Kind
B2
Abstract

Aspects of the present disclosure relate to optical systems with ergonomic presentation of content for use in head-worn computing systems. A method for controlling a head-worn computer when viewing virtual images, including image content, that encourages an ergonomic head position to reduce neck pain, includes determining an angle of the head-worn computer relative to horizontal, determining an angle of a line of sight to the center of the virtual image as presented to a user's eye, determining a deviation between the determined angle of the line of sight and a predetermined ergonomic angle, and shifting the image content of the virtual image vertically as displayed to the user's eye so that a portion of the image content is not viewable, wherein the amount of shifting is in reverse correspondence to the magnitude of the determined deviation.

Claims (57)

1. A method of presenting an image, the method comprising:

determining a base display image;

capturing, via a first one or more sensors of a wearable head device, an image of a user of the wearable head device;

determining, based on the captured image, a line of sight from the user to a center of a display of the wearable head device;

determining a viewing angle between the line of sight and a horizontal plane;

determining, based on a difference between the determined viewing angle and a desired viewing angle, that the base image should be adjusted;

in accordance with the determination that the base display image should be adjusted:

generating an edited display image, wherein generating the edited display image comprises:

cropping the base display image to reduce a vertical display size, and

shifting the base display image with respect to the horizontal plane, the shifting having a magnitude based on the difference between the determined viewing angle and the desired viewing angle and further having a vertical direction based on the difference between the determined viewing angle and the desired viewing angle; and

presenting the edited display image to the user via the display.

2. The method of claim 1 , wherein the desired angle is 20 degrees from the horizontal plane.

3. The method of claim 1 , wherein the position of the center of the display relative to the user is unaffected by lateral motion of the user.

4. The method of claim 1 , wherein the line of sight is determined based on an image plane of the base display image.

5. The method of claim 1 , wherein shifting the base display image comprises aligning the top of the base display image with the horizontal plane.

6. The method of claim 1 , wherein presenting the edited display image to the user via the display comprises presenting the edited display image in a plane orthogonal to the line of sight angle.

7. The method of claim 1 , wherein the captured image comprises an image of an eye of the user and the line of sight from the user to the center of the display comprises a line of sight from the eye to the center of the display.

8. The method of claim 1 , further comprising determining an orientation of the wearable head device relative to the user, wherein the line of sight from the user to the center of the display is determined based on the orientation.

9. The method of claim 1 , further comprising:

identifying, based on a second one or more sensors of the wearable head device, an activity of the user,

wherein the determination that the base display image should be adjusted is made based in part on the identified activity.

10. The method of claim 9 , wherein the determination that the base display image should be adjusted comprises a determination that the activity comprises viewing video content.

11. The method of claim 9 , wherein the determination that the base display image should be adjusted comprises a determination that the activity does not comprise traveling in a moving vehicle.

12. The method of claim 9 , wherein the determination that the base display image should be adjusted comprises a determination that the activity does not comprise walking or running.

13. The method of claim 9 , wherein the determination that the base display image should be adjusted comprises a determination that the activity does not comprise laying down.

14. The method of claim 9 , wherein the second one or more sensors include one or more of an IMU, a GPS unit, an altimeter, and a magnetometer.

15. A wearable device comprising:

a display:

a first one or more sensors; and

one or more processors configured to perform:

determining a base display image;

capturing, via the first one or more sensors, an image of a user of the wearable device;

determining, based on the captured image, a line of sight from the user to a center of the display;

determining a viewing angle between the line of sight and a horizontal plane;

determining, based on a difference between the determined viewing angle and a desired viewing angle, that the base image should be adjusted;

in accordance with the determination that the base display image should be adjusted:

generating an edited display image, wherein generating the edited display image comprises:

cropping the base display image to reduce a vertical display size, and

shifting the base display image with respect to the horizontal plane, the shifting having a magnitude based on the difference between the determined viewing angle and the desired viewing angle and further having a vertical direction based on the difference between the determined viewing angle and the desired viewing angle; and

presenting the edited display image to the user via the display.

16. The wearable device of claim 15 , wherein the captured image comprises an image of an eye of the user and the line of sight from the user to the center of the display comprises a line of sight from the eye to the center of the display.

17. The wearable device of claim 15 , further comprising a second one or more sensors, wherein:

the one or more processors are further configured to perform identifying, based on the second one or more sensors, an activity of the user, and

the determination that the base display image should be adjusted is made based on the identified activity.

18. A non-transitory computer readable storage medium storing instructions that, when executed, cause one or more processors to perform a method comprising:

determining a base display image;

capturing, via a first one or more sensors of a wearable head device, an image of a user of the wearable head device;

determining, based on the captured image, a line of sight from the user to a center of a display of the wearable head device;

determining a viewing angle between the line of sight and a horizontal plane;

determining, based on a difference between the determined viewing angle and a desired viewing angle, that the base image should be adjusted;

in accordance with the determination that the base display image should be adjusted:

generating an edited display image, wherein generating the edited display image comprises:

cropping the base display image to reduce a vertical display size, and

shifting the base display image with respect to the horizontal plane, the shifting having a magnitude based on the difference between the determined viewing angle and the desired viewing angle and further having a vertical direction based on the difference between the determined viewing angle and the desired viewing angle; and

presenting the edited display image to the user via the display.

19. The non-transitory computer readable storage medium of claim 18 , wherein the captured image comprises an image of an eye of the user and the line of sight from the user to the center of the display comprises a line of sight from the eye to the center of the display.

20. The non-transitory computer readable storage medium of claim 18 , wherein the method further comprises identifying, based on a second one or more sensors of the wearable head device, an activity of the user, and wherein the determination that the base display image should be adjusted is made based on the identified activity.

Assignments (10)
SECURITY INTEREST Recorded Nov 3, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073480/0540 →
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →
ASSIGNMENT OF PATENTS AND PATENT APPLICATIONS Recorded Apr 18, 2019
From: JGB COLLATERAL, LLC
To: MENTOR ACQUISITION ONE, LLC
Reel/Frame 048945/0939 →
SECURED PARTY BILL OF SALE Recorded Apr 18, 2019
From: OSTERHOUT GROUP, INC.
To: JGB COLLATERAL, LLC
Reel/Frame 051018/0883 →
SECURITY INTEREST Recorded Mar 15, 2018
From: OSTERHOUT GROUP, INC.
To: JGB COLLATERAL, LLC
Reel/Frame 045606/0295 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2018
From: SHAMS, NIMA L.; BORDER, JOHN N.; HADDICK, JOHN D.
To: OSTERHOUT GROUP, INC.
Reel/Frame 044859/0667 →
SECURITY INTEREST Recorded Oct 3, 2017
From: OSTERHOUT GROUP, INC.
To: O-FILM GLOBAL (HK) TRADING LIMITED
Reel/Frame 044127/0501 →
SECURITY INTEREST Recorded Sep 28, 2017
From: OSTERHOUT GROUP, INC.
To: 21ST CENTURY FOX AMERICA, INC.
Reel/Frame 044052/0367 →
Continuity (1)
Related Publication 20170256029A1 · Sep 7, 2017
Cited By (1)
US 12,405,466