IP Library Granted Patent US 12,045,401
Granted Patent B2
US 12,045,401 · App. 18/454,648 · Granted Jul 23, 2024

External user interface for head worn computing

Inventor: Ralph F. Osterhout (San Francisco, CA)
Assignee: Mentor Acquisition One, LLC
G06F3/03545B43K29/00B43K29/004B43K29/08G02B27/017G06F3/012G06F3/0304G06F3/0317G06F3/042G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,045,401
App. No.
18/454,648
Granted
Jul 23, 2024
Kind
B2
Abstract

Aspects of the present invention relate to external user interfaces used in connection with head worn computers (HWC).

Claims (34)

1. A method, comprising:

determining a virtual line in a mixed reality environment, the mixed reality environment visible to a user of a wearable device via a see-through display of the wearable device;

tracking a motion of a finger of the user as the finger moves relative to the virtual line, wherein said tracking comprises:

receiving, via a sensor, a signal indicative of a movement of the finger in the mixed reality environment relative to the virtual line; and

obtaining images of the movement of the finger;

determining, based on the signal, a first relative motion between the finger and the virtual line in the mixed reality environment;

determining, based on the images, a second relative motion between the finger and the virtual line in the mixed reality environment; and

determining an input sequence corresponding to one or more input strokes of the user, wherein the input sequence is determined based on a comparison of the first relative motion and the second relative motion.

2. The method of claim 1 , further comprising presenting the virtual line to the user via the see-through display.

3. The method of claim 1 , further comprising presenting the virtual line to the user via the see-through display as a portion of a message.

4. The method of claim 1 , further comprising presenting the virtual line to the user via the see-through display as a portion of an email.

5. The method of claim 1 , further comprising presenting the virtual line to the user via the see-through display as a portion of a writing platform.

6. The method of claim 1 , further comprising presenting the virtual line to the user via the see-through display as a portion of a painting platform.

7. The method of claim 1 , further comprising presenting the virtual line to the user via the see-through display as a portion of a drawing platform.

8. The method of claim 1 , further comprising presenting the input sequence via the see-through display relative to the virtual line.

9. The method of claim 8 , further comprising presenting the input sequence in real time.

10. The method of claim 1 , wherein said determining the input sequence comprises determining a position of the tip of the finger relative to the virtual line.

11. The method of claim 1 , wherein said motion comprises motion on a surface in the mixed reality environment and wherein said images comprise images of the surface.

12. The method of claim 1 , further comprising applying the input sequence to the mixed reality environment.

13. A non-transitory computer-readable storage medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:

determining a virtual line in a mixed reality environment, the mixed reality environment visible to a user of a wearable device via a see-through display of the wearable device;

tracking a motion of a finger of the user as the finger moves relative to the virtual line, wherein said tracking comprises:

receiving, via a sensor, a signal indicative of a movement of the finger in the mixed reality environment relative to the virtual line; and

obtaining images of the movement of the finger;

determining, based on the signal, a first relative motion between the finger and the virtual line in the mixed reality environment;

determining, based on the images, a second relative motion between the finger and the virtual line in the mixed reality environment; and

determining an input sequence corresponding to one or more input strokes of the user, wherein the input sequence is determined based on a comparison of the first relative motion and the second relative motion.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the method further comprises presenting the virtual line to the user via the see-through display.

15. The non-transitory computer-readable storage medium of claim 13 , wherein the method further comprises applying the input sequence to the mixed reality environment.

16. The non-transitory computer-readable storage medium of claim 13 , wherein the method further comprises presenting the input sequence via the see-through display relative to the virtual line.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the method further comprises presenting the input sequence in real time.

18. The non-transitory computer-readable storage medium of claim 13 , wherein said determining the input sequence comprises determining a position of the tip of the finger relative to the virtual line.

19. The non-transitory computer-readable storage medium of claim 13 , wherein said motion comprises motion on a surface in the mixed reality environment and wherein said images comprise images of the surface.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the method further comprises presenting the virtual line on the surface in the mixed reality environment via the see-through display.

Assignments (3)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073387/0487 →
SECURITY INTEREST Recorded Oct 20, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073008/0696 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2025
From: OSTERHOUT, RALPH F.
To: OSTERHOUT GROUP, INC.
Reel/Frame 072529/0446 →
Continuity (6)
Continuation 17961958 · Oct 7, 2022
Continuation 17494746 · Oct 5, 2021
Continuation 16378191 · Apr 8, 2019
Continuation 14280752 · May 19, 2014
Continuation In Part 14158198 · Jan 17, 2014
Related Publication 20230393674A1 · Dec 7, 2023
Cited By (1)
US 12,443,294