IP Library Granted Patent US 9,939,934
Granted Patent B2
US 9,939,934 · App. 14/158,198 · Granted Apr 10, 2018

External user interface for head worn computing

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,939,934
App. No.
14/158,198
Granted
Apr 10, 2018
Kind
B2
Abstract

Aspects of the present invention relate to external user interfaces used in connection with head worn computers (HWC). Embodiments relate to an external user interface that has a physical form intended to be hand held. The hand held user interface may be in the form similar to that of a writing instrument, such as a pen. In embodiments, the hand held user interface includes technologies relating to writing surface tip pressure monitoring, lens configurations setting a predetermined imaging distance, user interface software mode selection, quick software application launching, and other interface technologies.

Claims (21)

1. A method, comprising:

capturing an image from a writing surface end of a hand-held device;

determining, based at least in part on the image, that the writing surface end of the hand-held device is on a writing surface;

monitoring forces exerted on a writing surface end of the hand-held device over a period of time;

identifying a discrete force event during the period of time based on the monitored forces, the discrete force event including a sudden and substantial increase in force;

causing a graphic user interface element to appear in a display of a head-worn computer in the event that the discrete force event substantially matches a predetermined force signature;

wherein the hand-held device includes an inertial movement unit (IMU) to determine motion of the hand-held device, and

wherein the motion is used in coordination with an image of a writing surface to determine a stroke pattern.

2. The method of claim 1 , wherein the motion is used to predict a gesture, wherein the gesture is used to control an aspect of a graphical user interface.

3. The method of claim 1 , wherein the motion causes a selection of a user interface mode.

4. The method of claim 1 , wherein the force is identified using a piezo-electric device.

5. The method of claim 1 , wherein the hand-held device is in communication with a head-worn computer (HWC).

6. The method of claim 1 , wherein the user interface process is a selection of an item.

7. The method of claim 1 , wherein the user interface process produces a menu associated with a right-side click.

8. The method of claim 1 , wherein the user interface process produces a result associated with a double click.

9. A hand-held user interface device for a head-worn computer, comprising:

a force monitor adapted to measure forces exerted on a writing surface end of a hand-held device over a period of time;

a camera adapted to capture an image from the writing surface end of the hand-held device; and

a processor adapted to determine that the writing surface end of the hand-held device is on a writing surface based, at least in part, on the image, the processor further adapted to identify a discrete force event during the period of time based on the measured forces, the discrete force event including a sudden and substantial increase in force,

wherein the processor is adapted to communicate with the head-worn computer to cause a graphical user interface element to appear in a display of the head-worn computer in the event the discrete force event exceeds a predetermined threshold; and

wherein the hand-held device includes an inertial movement unit (IMU) to determine motion of the hand-held device, and wherein the motion is used in coordination with an image of a writing surface to determine a stroke pattern.

Assignments (8)
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →
SECURED PARTY BILL OF SALE Recorded Apr 18, 2019
From: OSTERHOUT GROUP, INC.
To: JGB COLLATERAL, LLC
Reel/Frame 051018/0883 →
ASSIGNMENT OF PATENTS AND PATENT APPLICATIONS Recorded Apr 18, 2019
From: JGB COLLATERAL, LLC
To: MENTOR ACQUISITION ONE, LLC
Reel/Frame 048945/0939 →
SECURITY INTEREST Recorded Mar 15, 2018
From: OSTERHOUT GROUP, INC.
To: JGB COLLATERAL, LLC
Reel/Frame 045606/0295 →
SECURITY INTEREST Recorded Oct 3, 2017
From: OSTERHOUT GROUP, INC.
To: O-FILM GLOBAL (HK) TRADING LIMITED
Reel/Frame 044127/0501 →
SECURITY INTEREST Recorded Sep 28, 2017
From: OSTERHOUT GROUP, INC.
To: 21ST CENTURY FOX AMERICA, INC.
Reel/Frame 044052/0367 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2014
From: OSTERHOUT, RALPH F.; BORDER, JOHN N.; NORTRUP, EDWARD H.
To: OSTERHOUT GROUP, INC.
Reel/Frame 034562/0826 →