IP Library Patent Application 19031367
Patent Application
App. No. 19/031,367

PREDICTIVE INFORMATION FOR FREE SPACE GESTURE CONTROL AND COMMUNICATION

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
19/031,367
Abstract

The technology disclosed relates to simplifying updating of a predictive model using clustering observed points. In particular, it relates to observing a set of points in 3D sensory space, determining surface normal directions from the points, clustering the points by their surface normal directions and adjacency, accessing a predictive model of a hand, refining positions of segments of the predictive model, matching the clusters of the points to the segments, and using the matched clusters to refine the positions of the matched segments. It also relates to distinguishing between alternative motions between two observed locations of a control object in a 3D sensory space by accessing first and second positions of a segment of a predictive model of a control object such that motion between the first position and the second position was at least partially occluded from observation in a 3D sensory space.

Claims (48)

1 . A non-transitory computer readable medium, storing processor executable instructions to update a predictive model, which instructions when executed by a processor implement actions, including:

accessing a predictive model of a hand;

obtaining using points in a set of points and the predictive model, a refined predictive model having refined positions of segments determined for the set of points; and

using the predictive model as refined to interpret a control object's position and/or motion.

2 . The non-transitory computer readable medium of claim 1 , wherein obtaining using the points and the predictive model, a refined predictive model further includes:

selecting a reference vector and determining a difference in angle between surface normal directions determined from the points and the reference vector; and

using a magnitude of the difference to cluster the points.

3 . The non-transitory computer readable medium of claim 2 , wherein the reference vector is orthogonal to a field of view of camera used to capture the points on an image.

4 . The non-transitory computer readable medium of claim 2 , wherein the reference vector is along a longitudinal axis of the hand.

5 . The non-transitory computer readable medium of claim 2 , wherein the reference vector is along a longitudinal axis of a portion of the hand.

6 . The non-transitory computer readable medium of claim 1 , wherein obtaining using the points and the predictive model, a refined predictive model further includes calculating an error indication by:

determining whether the points and points on the segments of the predictive model are within a threshold closest distance.

7 . The non-transitory computer readable medium of claim 6 , further including instructions for calculating an error indication by:

pairing the points in the set of points with points on axes of the segments of the predictive model, wherein the points in the set of points lie on vectors that are normal to at least one axis of the segments of the predictive model; and

determining a reduced root mean squared deviation (RMSD) of distances between paired point sets.

8 . The non-transitory computer readable medium of claim 6 , further including instructions for calculating an error indication by:

pairing the points in the set of points with points on the segments of the predictive model, wherein normal vectors to the points in the set of points are parallel to each other; and

determining a reduced root mean squared deviation (RMSD) of distances between bases of the normal vectors.

9 . The non-transitory computer readable medium of claim 1 , wherein obtaining using the points and the predictive model, a refined predictive model further includes:

determining physical proximity between points in the set of points;

based on the determined physical proximity, identifying co-located segments of the predictive model that change positions together; and

refining positions of segments of the predictive model responsive to the co-located segments.

10 . The non-transitory computer readable medium of claim 9 , wherein the co-located segments represent adjoining figures of the hand.

11 . The non-transitory computer readable medium of claim 9 , wherein the co-located segments represent subcomponents of a same finger.

12 . A non-transitory computer readable medium, storing instructions for distinguishing between alternative motions between two observed locations of a control object in a three-dimensional (3D) sensory space, which instructions, when executed by one or more processors perform actions including:

accessing a first position and a second position of a segment of a control object;

receiving two or more alternative interpretations of movement from the first position to the second position;

receiving a selection of an alternative interpretation of the two or more alternative interpretations; and

using the alternative interpretation selected to interpret a control object's position and/or motion.

13 . The non-transitory computer readable medium of claim 12 , wherein the control object is a hand.

14 . The non-transitory computer readable medium of claim 12 , wherein the control object is a tool.

15 . A system enabling updating a predictive model comprising:

a gesture database comprising a electronically stored information, the electronically stored information relating to a predictive model of a hand; and

an image analyzer coupled to the gesture database and having one or more hardware processors configured with logic to:

access a particular predictive model of the hand;

obtain using points in a set of points defined for the hand and the predictive model, a refined predictive model having refined positions of segments determined for the set of points; and

using the predictive model as refined to interpret a control object's position and/or motion.

16 . The system of claim 15 , wherein the image analyzer further includes logic to:

select a reference vector and determine a difference in angle between surface normal directions determined from the points and the reference vector; and

use a magnitude of the difference to cluster the points.

17 . The system of claim 16 , wherein the reference vector is orthogonal to the hand as imaged.

18 . The system of claim 16 , wherein the reference vector is along a longitudinal axis of the hand.

19 . The system of claim 16 , wherein the reference vector is along a longitudinal axis of a portion of the hand.

20 . A computer implemented method to distinguish between alternative motions between two observed locations of a control object in a three-dimensional (3D) sensory space, the method including:

accessing a first position and a second position of a segment of a control object;

receiving two or more alternative interpretations of movement from the first position to the second position;

receiving a selection of an alternative interpretation of the two or more alternative interpretations; and

using the alternative interpretation selected to interpret a control object's position and/or motion.

Assignments (6)
SECURITY INTEREST Recorded Apr 6, 2026
From: SIM IP HXR LLC
To: UNITY MASTER LLC SERIES XIX
Reel/Frame 075365/0907 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2026
From: ULTRAHAPTICS IP TWO LIMITED
To: SIM IP HXR LLC
Reel/Frame 075132/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2026
From: ULTRAHAPTICS LIMITED; ULTRAHAPTICS IP LIMITED; ULTRAHAPTICS IP TWO LIMITED; ULTRALEAP LIMITED
To: SIM IP HXR LLC
Reel/Frame 074404/0463 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2025
From: HOLZ, DAVID S.; HOROWITZ, KEVIN; BEDIKIAN, RAFFI; YANG, HUA
To: LEAP MOTION, INC.
Reel/Frame 070061/0738 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2025
From: LEAP MOTION, INC.
To: LMI LIQUIDATING CO. LLC¿
Reel/Frame 070061/0797 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2025
From: LMI LIQUIDATING CO. LLC
To: ULTRAHAPTICS IP TWO LIMITED
Reel/Frame 070061/0856 →