IP Library › Granted Patent US 9,939,934
Granted Patent B2
US 9,939,934 · App. 14/158,198 · Granted Apr 10, 2018

External user interface for head worn computing

Inventors: Ralph F. Osterhout (San Francsico, CA); John N. Border (Walworth, NY); Edward H. Nortrup (Stoneham, MA)
Assignee: Osterhout Group, Inc.
G06F3/038G02B27/017G04G17/08G04G17/083G04G21/00G04G21/025G04G21/08G06F1/163G06F3/005G06F3/017G06F3/0346G06F3/0386G06F3/03542G06F3/03545G06F3/044G06F3/0482G06F3/04842G06F3/04847G06F3/04883G06F3/1454G09G5/12G02B2027/014G02B2027/0138G02B2027/0178G02B2027/0187G09G2354/00G09G2370/06G09G2370/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,939,934
App. No.
14/158,198
Filed
Jan 17, 2014
Granted
Apr 10, 2018
Kind
B2
Art Unit
2697
USPC
345/179
Abstract

Aspects of the present invention relate to external user interfaces used in connection with head worn computers (HWC). Embodiments relate to an external user interface that has a physical form intended to be hand held. The hand held user interface may be in the form similar to that of a writing instrument, such as a pen. In embodiments, the hand held user interface includes technologies relating to writing surface tip pressure monitoring, lens configurations setting a predetermined imaging distance, user interface software mode selection, quick software application launching, and other interface technologies.

Claims (21)

1. A method, comprising:

capturing an image from a writing surface end of a hand-held device;

determining, based at least in part on the image, that the writing surface end of the hand-held device is on a writing surface;

monitoring forces exerted on a writing surface end of the hand-held device over a period of time;

identifying a discrete force event during the period of time based on the monitored forces, the discrete force event including a sudden and substantial increase in force;

causing a graphic user interface element to appear in a display of a head-worn computer in the event that the discrete force event substantially matches a predetermined force signature;

wherein the hand-held device includes an inertial movement unit (IMU) to determine motion of the hand-held device, and

wherein the motion is used in coordination with an image of a writing surface to determine a stroke pattern.

2. The method of claim 1 , wherein the motion is used to predict a gesture, wherein the gesture is used to control an aspect of a graphical user interface.

3. The method of claim 1 , wherein the motion causes a selection of a user interface mode.

4. The method of claim 1 , wherein the force is identified using a piezo-electric device.

5. The method of claim 1 , wherein the hand-held device is in communication with a head-worn computer (HWC).

6. The method of claim 1 , wherein the user interface process is a selection of an item.

7. The method of claim 1 , wherein the user interface process produces a menu associated with a right-side click.

8. The method of claim 1 , wherein the user interface process produces a result associated with a double click.

9. A hand-held user interface device for a head-worn computer, comprising:

a force monitor adapted to measure forces exerted on a writing surface end of a hand-held device over a period of time;

a camera adapted to capture an image from the writing surface end of the hand-held device; and

a processor adapted to determine that the writing surface end of the hand-held device is on a writing surface based, at least in part, on the image, the processor further adapted to identify a discrete force event during the period of time based on the measured forces, the discrete force event including a sudden and substantial increase in force,

wherein the processor is adapted to communicate with the head-worn computer to cause a graphical user interface element to appear in a display of the head-worn computer in the event the discrete force event exceeds a predetermined threshold; and

wherein the hand-held device includes an inertial movement unit (IMU) to determine motion of the hand-held device, and wherein the motion is used in coordination with an image of a writing surface to determine a stroke pattern.

Assignments (8)
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →
ASSIGNMENT OF PATENTS AND PATENT APPLICATIONS Recorded Apr 18, 2019
From: JGB COLLATERAL, LLC
To: MENTOR ACQUISITION ONE, LLC
Reel/Frame 048945/0939 →
SECURED PARTY BILL OF SALE Recorded Apr 18, 2019
From: OSTERHOUT GROUP, INC.
To: JGB COLLATERAL, LLC
Reel/Frame 051018/0883 →
SECURITY INTEREST Recorded Mar 15, 2018
From: OSTERHOUT GROUP, INC.
To: JGB COLLATERAL, LLC
Reel/Frame 045606/0295 →
SECURITY INTEREST Recorded Oct 3, 2017
From: OSTERHOUT GROUP, INC.
To: O-FILM GLOBAL (HK) TRADING LIMITED
Reel/Frame 044127/0501 →
SECURITY INTEREST Recorded Sep 28, 2017
From: OSTERHOUT GROUP, INC.
To: 21ST CENTURY FOX AMERICA, INC.
Reel/Frame 044052/0367 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2014
From: OSTERHOUT, RALPH F.; BORDER, JOHN N.; NORTRUP, EDWARD H.
To: OSTERHOUT GROUP, INC.
Reel/Frame 034562/0826 →
Continuity (1)
Related Publication 20150205385A1 · Jul 23, 2015