IP Library Granted Patent US 12,174,378
Granted Patent B2
US 12,174,378 · App. 18/461,436 · Granted Dec 24, 2024

External user interface for head worn computing

Inventors: Ralph F. Osterhout (San Francisco, CA); Robert Michael Lohse (Palo Alto, CA); Manuel Antonio Sanchez (El Sobrante, CA)
Assignee: Mentor Acquisition One, LLC
G02B27/017G06T19/006G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,174,378
App. No.
18/461,436
Granted
Dec 24, 2024
Kind
B2
Abstract

Aspects of the present invention relate to external user interfaces used in connection with head-worn computers (HWC).

Claims (50)

1. A system comprising:

a wearable device comprising a see-through display;

a vehicle comprising a physical control, the physical control configured to control an operation associated with the vehicle and further configured to move with respect to an interior of the vehicle, the vehicle configured to communicate with the wearable device; and

an external user interface, the external user interface mechanically coupled to the physical control and configured to communicate with the wearable head device, wherein:

the wearable device is configured to present, via the see-through display, concurrently with presenting a view of the physical control, virtual content to a user;

the presenting the virtual content comprises:

at a first time, presenting via the see-through display a first user interface element aligned with the external user interface and at a first position with respect to the interior of the vehicle,

at a second time, in response to a movement of the physical control with respect to the interior of the vehicle, presenting via the see-through display the first user interface element aligned with the external user interface and at a second position with respect to the interior of the vehicle, a displacement between the first position with respect to the interior of the vehicle and the second position with respect to the interior of the vehicle corresponding to the movement of the external user interface, and

presenting via the see-through display a second user interface element at a third position with respect to the interior of the vehicle, the third position different from the first position with respect to the interior of the vehicle and the second position with respect to the interior of the vehicle; and

a control command associated with the operation of the vehicle is generated in response to an interaction of the user with the first user interface element.

2. The system of claim 1 , wherein the physical control comprises one or more of a steering wheel, a shift lever, and a handle.

3. The system of claim 1 , wherein:

the physical control is configured to provide input to the wearable device; and

the wearable device is further configured to:

in response to receiving the input from the physical control, update the presentation of the virtual content via the see-through display.

4. The system of claim 3 , wherein the updating the presentation of the virtual content via the see-through display comprises increasing or decreasing an amount of virtual content presented via the see-through display.

5. The system of claim 3 , wherein the updating the presentation of the virtual content via the see-through display comprises clearing a region of the see-through display of virtual content.

6. The system of claim 1 , further comprising a third user interface element comprising one or more of a button, a touch pad, a touch screen, and a switch.

7. The system of claim 1 , wherein the virtual content comprises text corresponding to a command set selected via the wearable device.

8. The system of claim 7 , wherein the command set comprises one or more navigation commands.

9. The system of claim 1 , wherein the virtual content comprises navigation information.

10. The system of claim 1 , wherein the virtual content comprises system information for the vehicle.

11. The system of claim 1 , wherein the virtual content comprises point-of-interest information.

12. The system of claim 1 , wherein the virtual content comprises an advertisement.

13. The system of claim 1 , wherein one or more of the first user interface element and second user interface element are associated with an application associated with the vehicle or the wearable device.

14. A method, comprising:

controlling, via a physical control of a vehicle, an operation associated with the vehicle, wherein the physical control is configured to move with respect to an interior of the vehicle;

presenting, via a see-through display of a wearable device, concurrently with presenting a view of the physical control, virtual content to a user, wherein:

the vehicle is configured to communicate with the wearable device,

an external user interface is mechanically coupled to the physical control and is configured to communicate with the wearable head device,

the presenting the virtual content comprises:

at a first time, presenting via the see-through display a first user interface element aligned with the external user interface and at a first position with respect to the interior of the vehicle,

at a second time, in response to a movement of the physical control with respect to the interior of the vehicle, presenting via the see-through display the first user interface element aligned with the external user interface and at a second position with respect to the interior of the vehicle, a displacement between the first position with respect to the interior of the vehicle and the second position with respect to the interior of the vehicle corresponding to the movement of the external user interface, and

presenting via the see-through display a second user interface element at a third position with respect to the interior of the vehicle, the third position different from the first position with respect to the interior of the vehicle and the second position with respect to the interior of the vehicle; and

in response to an interaction of the user with the first user interface element, generating a control command associated with the operation of the vehicle.

15. The method of claim 14 , wherein the physical control comprises one or more of a steering wheel, a shift lever, and a handle.

16. The method of claim 14 , further comprising:

providing, via the physical control, an input to the wearable device; and

in response to receiving the input from the physical control, updating the presentation of the virtual content via the see-through display.

17. The method of claim 14 , wherein the the vehicle further comprises a third user interface element comprising one or more of a button, a touch pad, a touch screen, and a switch.

18. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:

controlling, via a physical control of a vehicle, an operation associated with the vehicle, wherein the physical control is configured to move with respect to an interior of the vehicle;

presenting, via a see-through display of a wearable device, concurrently with presenting a view of the physical control, virtual content to a user, wherein:

the vehicle is configured to communicate with the wearable device,

an external user interface is mechanically coupled to the physical control and is configured to communicate with the wearable head device,

the presenting the virtual content comprises:

at a first time, presenting via the see-through display a first user interface element aligned with the external user interface and at a first position with respect to the interior of the vehicle,

at a second time, in response to a movement of the physical control with respect to the interior of the vehicle, presenting via the see-through display the first user interface element aligned with the external user interface and at a second position with respect to the interior of the vehicle, a displacement between the first position with respect to the interior of the vehicle and the second position with respect to the interior of the vehicle corresponding to the movement of the external user interface, and

presenting via the see-through display a second user interface element at a third position with respect to the interior of the vehicle, the third position different from the first position with respect to the interior of the vehicle and the second position with respect to the interior of the vehicle; and

in response to an interaction of the user with the first user interface element, generating a control command associated with the operation of the vehicle.

Assignments (3)
SECURITY INTEREST Recorded Oct 29, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073438/0463 →
SECURITY INTEREST Recorded Oct 20, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073031/0206 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 10, 2025
From: OSTERHOUT, RALPH F.; LOHSE, ROBERT MICHAEL; SANCHEZ, MANUEL ANTONIO
To: OSTERHOUT GROUP, INC.
Reel/Frame 072534/0294 →
Continuity (6)
Continuation 17670373 · Feb 11, 2022
Continuation 17338484 · Jun 3, 2021
Continuation 16915919 · Jun 29, 2020
Continuation 15785505 · Oct 17, 2017
Continuation 14307114 · Jun 17, 2014
Related Publication 20230418064A1 · Dec 28, 2023