IP Library Granted Patent US 11,294,180
Granted Patent B2
US 11,294,180 · App. 17/338,484 · Granted Apr 5, 2022

External user interface for head worn computing

Inventors: Ralph F. Osterhout (San Francisco, CA); Robert Michael Lohse (Palo Alto, CA); Manuel Antonio Sanchez (El Sobrante, CA)
Assignee: Mentor Acquisition One, LLC
G02B27/017G06T19/006G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,294,180
App. No.
17/338,484
Granted
Apr 5, 2022
Kind
B2
Abstract

Aspects of the present invention relate to external user interfaces used in connection with head-worn computers (HWC).

Claims (44)

1. A wearable device comprising a see-through display and one or more processors configured to communicate with a vehicle,

wherein:

the vehicle comprises a physical control comprising a first region, the physical control configured to control an operation of the vehicle and further configured to move with respect to an interior of the vehicle,

the wearable device is configured to present, via the see-through display, concurrently with presenting a view of the first region, virtual content to a user, and

presenting the virtual content comprises:

at a first time, presenting via the see-through display a user interface element at a first position with respect to the first region and at a first position with respect to the interior of the vehicle,

at a second time, in response to a movement of the physical control, presenting via the see-through display the user interface element at the first position with respect to the first region and at a second position with respect to the interior of the vehicle, a displacement between the first position with respect to the interior of the vehicle and the second position with respect to the interior of the vehicle corresponding to a movement of the physical control, and

the wearable device is further configured to generate a control command in response to an interaction of the user with the user interface element at the first position with respect to the first region.

2. The wearable device of claim 1 , wherein the physical control comprises one or more of a steering wheel, a shift lever, and a handle.

3. The wearable device of claim 1 , wherein:

the physical control is configured to provide input to the wearable device; and

the wearable device is further configured to:

in response to receiving input from the physical control, adjust the presentation of the virtual content via the see-through display.

4. The wearable device of claim 3 , wherein adjusting the presentation of the virtual content via the see-through display comprises increasing or decreasing an amount of virtual content presented via the see-through display.

5. The wearable device of claim 3 , wherein adjusting the presentation of the virtual content via the see-through display comprises clearing a region of the see-through display of virtual content.

6. The wearable device of claim 3 , wherein the physical control comprises one or more of a button, a touch pad, a touch screen, and a switch.

7. The wearable device of claim 1 , wherein the virtual content comprises text corresponding to a command set selected via the wearable device.

8. The wearable device of claim 7 , wherein the command set comprises one or more navigation commands.

9. A method comprising:

presenting, via a see-through display of a wearable device, virtual content to a user; and

concurrently with presenting the virtual content, presenting to the user, via the see-through display, a view of a first region of a physical control of a vehicle, the physical control configured to move with respect to an interior of the vehicle,

wherein presenting the virtual content comprises:

at a first time, presenting via the see-through display a user interface element at a first position with respect to the first region and at a first position with respect to the interior of the vehicle,

at a second time, in response to a movement of the physical control, presenting via the see-through display the user interface element at the first position with respect to the first region and at a second position with respect to the interior of the vehicle, wherein a displacement between the first position with respect to the interior of the vehicle and the second position with respect to the interior of the vehicle corresponds to a movement of the physical control; and

generating a control command in response to an interaction of the user with the user interface element at the first position with respect to the first region.

10. The method of claim 9 , wherein the physical control comprises one or more of a steering wheel, a shift lever, and a handle.

11. The method of claim 9 , wherein the physical control is configured to provide input to the wearable device, and wherein the method further comprises:

in response to receiving input from the physical control, adjusting the presentation of the virtual content via the see-through display.

12. The method of claim 11 , wherein adjusting the presentation of the virtual content comprises increasing or decreasing an amount of virtual content presented via the see-through display.

13. The method of claim 11 , wherein adjusting the presentation of the virtual content comprises clearing a region of the see-through display of virtual content.

14. The method of claim 9 , wherein the virtual content comprises text corresponding to a command set selected via the wearable device.

15. The method of claim 14 , wherein the command set comprises one or more navigation commands.

16. A non-transitory computer-readable medium containing instructions which, when executed by one or more processors, cause the one or more processors to execute a method comprising:

presenting, via a see-through display of a wearable device, virtual content to a user; and

concurrently with presenting the virtual content, presenting to the user, via the see-through display, a view of a first region of a physical control of a vehicle, the physical control configured to move with respect to an interior of the vehicle,

wherein presenting the virtual content comprises:

at a first time, presenting via the see-through display a user interface element at a first position with respect to the first region and at a first position with respect to the interior of the vehicle,

at a second time, in response to a movement of the physical control, presenting via the see-through display the user interface element at the first position with respect to the first region and at a second position with respect to the interior of the vehicle, wherein a displacement between the first position with respect to the interior of the vehicle and the second position with respect to the interior of the vehicle corresponds to a movement of the physical control; and

generating a control command in response to an interaction of the user with the user interface element at the first position with respect to the first region.

17. The non-transitory computer-readable medium of claim 16 , wherein the physical control comprises one or more of a steering wheel, a shift lever, and a handle.

18. The non-transitory computer-readable medium of claim 16 , wherein the physical control is configured to provide input to the wearable device, and wherein the method further comprises:

in response to receiving input from the physical control, adjusting the presentation of the virtual content via the see-through display.

19. The non-transitory computer-readable medium of claim 16 , wherein the virtual content comprises text corresponding to a command set selected via the wearable device.

20. The non-transitory computer-readable medium of claim 19 , wherein the command set comprises one or more navigation commands.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 10, 2025
From: OSTERHOUT, RALPH F.; LOHSE, ROBERT MICHAEL; SANCHEZ, MANUEL ANTONIO
To: OSTERHOUT GROUP, INC.
Reel/Frame 072534/0294 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
Continuity (4)
Continuation 16915919 · Jun 29, 2020
Continuation 15785505 · Oct 17, 2017
Continuation 14307114 · Jun 17, 2014
Related Publication 20210356741A1 · Nov 18, 2021