IP Library Granted Patent US 10,901,519
Granted Patent B2
US 10,901,519 · App. 16/660,528 · Granted Jan 26, 2021

Cursor mode switching

Inventor: David S. Holz (San Francisco, CA)
Assignee: Ultrahaptics IP Two Limited
G06F3/017B65D75/5877G06F3/005G06F3/0304G06F3/0346G06K9/00335
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,901,519
App. No.
16/660,528
Granted
Jan 26, 2021
Kind
B2
Abstract

Methods and systems for processing input from an image-capture device for gesture-recognition. The method further includes computationally interpreting user gestures in accordance with a first mode of operation; analyzing the path of movement of an object to determine an intent of a user to change modes of operation; and, upon determining an intent of the user to change modes of operation, subsequently interpreting user gestures in accordance with the second mode of operation.

Claims (44)

1. A system for gesture-recognition, comprising:

an image-capture device for obtaining digital images of an object in 3D space;

a processor-executable analysis module for computationally determining a path of movement of the object based on captured images;

a computer memory for storing a digital representation of the path of movement; and

a processor-executable mode-control module configured for:

interpreting user gestures in accordance with a first mode of operation comprising a drawing mode in which a line is displayed following movement of a finger and a second mode of operation comprising a movement mode in which no line is displayed;

analyzing the path of movement to determine an intent of a user to change modes of operation according to which user gestures are interpreted by:

determining an amount or direction of curvature of the path of movement; and

based upon the amount or direction of curvature of the path of movement, determining an intent of the user to change modes of operation to the drawing mode; and

when in drawing mode, filling in a displayed line at a rate that is faster than a detected rate of the finger until the displayed line catches up with the finger, and thereafter displaying movement of the finger at the detected rate of the finger.

2. The system of claim 1 , wherein filling in a displayed line includes displaying a line from a starting point of the path of movement to a current position of the finger when intent of the user to change modes of operation to the drawing mode.

3. The system of claim 1 , wherein filling in a displayed line includes passing position data relating to the finger to a drawing application.

4. The system of claim 1 , wherein no position data is passed until a mode of the gesture is determined, after which faster-rate motion is passed until the displayed line catches up to a current position for the finger.

5. The system of claim 4 , further including passing normal-rate position information after the displayed line catches up to the current position for the finger.

6. The system of claim 1 , wherein a discontinuity or jolt is displayed as distance traveled by the finger is filled in once the mode is determined to be a drawing mode.

7. The system of claim 1 , further including re-tracing a path already traveled by the finger by drawing in the path at a higher velocity than that traveled by the finger.

8. The system of claim 1 , wherein a mode for a gesture is not determined until after the object making the gesture has traveled some distance in 3D space.

9. The system of claim 1 , wherein no line is displayed for movement along a path when in movement mode.

10. A method of computationally interpreting gestures, the method comprising:

obtaining digital images of a real-world object in 3D space;

computationally determining a path of movement of the real-world object based on captured images;

interpreting user gestures in accordance with a first mode of operation comprising a drawing mode in which a line is displayed following movement of a finger and a second mode of operation comprising a movement mode in which no line is displayed;

analyzing the path of movement to determine an intent of a user to change modes of operation according to which user gestures are interpreted by:

determining an amount or direction of curvature of the path of movement; and

based upon the amount or direction of curvature of the path of movement, determining an intent of the user to change modes of operation to the drawing mode; and

when in drawing mode, filling in a displayed line at a rate that is faster than a detected rate of the finger until the displayed line catches up with the finger, and

thereafter displaying movement of the finger at the detected rate of the finger.

11. The method of claim 10 , wherein filling in a displayed line includes displaying a line from a starting point of the path of movement to a current position of the finger when intent of the user to change modes of operation to the drawing mode.

12. The method of claim 10 , wherein filling in a displayed line includes passing position data relating to the finger to a drawing application.

13. The method of claim 10 , wherein no position data is passed until a mode of the gesture is determined, after which faster-rate motion is passed until the displayed line catches up to a current position for the finger.

14. The method of claim 13 , further including passing normal-rate position information after the displayed line catches up to the current position for the finger.

15. The method of claim 10 , further including displaying a discontinuity or jolt as distance traveled by the finger is filled in once the mode is determined to be a drawing mode.

16. The method of claim 10 , further including re-tracing a path already traveled by the finger by drawing in the path at a higher velocity than that traveled by the finger.

17. The method of claim 10 , wherein a mode for a gesture is not determined until after the object making the gesture has traveled some distance in 3D space.

18. The method of claim 10 , wherein no line is displayed for movement along a path when in movement mode.

19. A non-transitory computer readable storage medium impressed with computer program instructions to computationally interpret gestures, which instructions, when executed on a processor, implement:

obtaining digital images of a real-world object in 3D space;

computationally determining a path of movement of the real-world object based on captured images;

interpreting user gestures in accordance with a first mode of operation comprising a drawing mode in which a line is displayed following movement of a finger and a second mode of operation comprising a movement mode in which no line is displayed;

analyzing the path of movement to determine an intent of a user to change modes of operation according to which user gestures are interpreted by:

determining an amount or direction of curvature of the path of movement; and

based upon the amount or direction of curvature of the path of movement, determining an intent of the user to change modes of operation to the drawing mode; and

when in drawing mode, filling in a displayed line at a rate that is faster than a detected rate of the finger until the displayed line catches up with the finger, and thereafter displaying movement of the finger at the detected rate of the finger.

20. The non-transitory computer readable storage medium of claim 19 , wherein filling in a displayed line includes displaying a line from a starting point of the path of movement to a current position of the finger when intent of the user to change modes of operation to the drawing mode.

Assignments (5)
SECURITY INTEREST Recorded Apr 6, 2026
From: SIM IP HXR LLC
To: UNITY MASTER LLC SERIES XIX
Reel/Frame 075365/0907 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2026
From: ULTRAHAPTICS IP TWO LIMITED
To: SIM IP HXR LLC
Reel/Frame 075127/0488 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2025
From: HOLZ, DAVID S.
To: LEAP MOTION, INC.
Reel/Frame 070185/0635 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2025
From: LEAP MOTION, INC.
To: LMI LIQUIDATING CO. LLC¿
Reel/Frame 070185/0662 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2025
From: LMI LIQUIDATING CO. LLC
To: ULTRAHAPTICS IP TWO LIMITED
Reel/Frame 070185/0711 →