IP Library Granted Patent US 12,141,366
Granted Patent B2
US 12,141,366 · App. 18/150,328 · Granted Nov 12, 2024

Gesture recognition system and method of using same

Inventors: Denver Halbert Dash (Plantation, FL); Emre Tanirgan (Plantation, FL)
Assignee: Magic Leap, Inc.
G06F3/017G06F3/011G06V10/34G06V20/20G06V40/113G06V40/28
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,141,366
App. No.
18/150,328
Granted
Nov 12, 2024
Kind
B2
Abstract

A method of executing a gesture command includes identifying a hand centroid of a hand. The method also includes identifying a first finger tip of a first finger on the hand. The method further includes identifying a thumb tip of a thumb on the hand. Moreover, the method includes determining a surface normal relationship between the hand centroid, the first fingertip and the thumb tip.

Claims (31)

1. A method of executing a gesture command, comprising:

identifying a point of a hand between a wrist and a base of fingers of the hand;

identifying a first finger tip of a first finger on the hand;

identifying a thumb tip of a thumb on the hand;

determining surface normals respectively at the point of the hand, the first finger tip, and the thumb tip;

computing angles between the respective surface normals;

determining that the respective surface normals at the point of the hand on a caudal surface of the hand, at the first finger tip, and at the thumb tip are substantially parallel based on the computed angles between the respective surface normal;

determining an L-shaped gesture of the hand based at least in part on determining that the respective surface normals at the point of the hand on a caudal surface of the hand, at the first finger tip, and at the thumb tip are substantially parallel;

displaying a cursor in a field of view at a location corresponding to the first finger tip in response to determining the L-shaped gesture; and

maintaining the cursor at the location corresponding to the first finger tip after the first finger moves.

2. The method of claim 1 , further comprising:

determining an angle between the first finger tip, the point of the hand, and the thumb tip, and

determining the L-shaped gesture of the hand based at least in part on determining the angle is approximately 90 degrees.

3. The method of claim 1 , further comprising:

detecting a movement of the thumb tip to a mapped planar position between the point of the hand and the first finger tip; and

executing a command at the cursor location in response to detecting the movement.

4. The method of claim 1 , further comprising:

calculating a first line between the first finger tip and the point of the hand;

calculating a second line between the thumb tip and the point of the hand;

determining an angular relationship between the first and second lines; and

determining a gesture of the hand based on the determined angular relationship between the first and second lines.

5. The method of claim 4 , further comprising:

determining that the first and second lines are substantially orthogonal based on the determined angular relationship between the first and second lines; and

determining the L-shaped gesture of the hand based at least in part on determining the first and second lines are substantially orthogonal.

6. The method of claim 4 , wherein a virtual cursor is displayed in a field of view at a location corresponding to the first finger tip.

7. The method of claim 6 , further comprising:

detecting a change in the angular relationship between the first and second lines; and

executing a command at the cursor location in response to detecting the change in the angular relationship between the first and second lines.

8. The method of claim 7 , wherein the change in the angular relationship between the first and second lines is a threshold amount of decrease in an angle between first and second lines.

9. The method of claim 8 , wherein the threshold amount of decrease is about 30 degrees.

10. The method of claim 1 , wherein the point of the hand is a hand centroid.

Assignments (3)
SECURITY INTEREST Recorded Oct 29, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073438/0463 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2024
From: DASH, DENVER HALBERT; TANIRGAN, EMRE
To: MAGIC LEAP, INC.
Reel/Frame 068816/0001 →
SECURITY INTEREST Recorded Feb 7, 2023
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 062681/0065 →