Granted Patent B2

US 12,265,761 · App. 18/406,059 · Granted Apr 1, 2025

Inventors: David S. Holz (San Francisco, CA); Kevin Horowitz (San Francisco, CA); Raffi Bedikian (San Francisco, CA); Hua Yang (Millbrae, CA)

Assignee: ULTRAHAPTICS IP TWO LIMITED

G06F30/20G06F3/017G06V20/64G06V40/28

Abstract

Claims (49)

1. A computer implemented method of updating a predictive model, the method including:

accessing a predictive model of a hand;

obtaining using points in a set of points and the predictive model, a refined predictive model having refined positions of segments determined for the set of points; and

using the predictive model as refined to interpret a control object's position and/or motion.

2. The method of claim 1 , wherein obtaining using the points and the predictive model, a refined predictive model further includes:

selecting a reference vector and determining a difference in angle between surface normal directions determined from the points and the reference vector; and

using a magnitude of the difference to cluster the points.

3. The method of claim 2 , wherein the reference vector is orthogonal to a field of view of camera used to capture the points on an image.

4. The method of claim 2 , wherein the reference vector is along a longitudinal axis of the hand.

5. The method of claim 2 , wherein the reference vector is along a longitudinal axis of a portion of the hand.

6. The method of claim 1 , wherein obtaining using the points and the predictive model, a refined predictive model further includes calculating an error indication by:

determining whether the points and points on the segments of the predictive model are within a threshold closest distance.

7. The method of claim 6 , further including calculating an error indication by:

pairing the points in the set of points with points on axes of the segments of the predictive model, wherein the points in the set of points lie on vectors that are normal to the axes; and

determining a reduced root mean squared deviation (RMSD) of distances between paired point sets.

8. The method of claim 6 , further including calculating an error indication by:

pairing the points in the set of points with points on the segments of the predictive model, wherein normal vectors to the points in the set of points are parallel to each other; and

determining a reduced root mean squared deviation (RMSD) of distances between bases of the normal vectors.

9. The method of claim 1 , wherein obtaining using the points and the predictive model, a refined predictive model further includes:

determining physical proximity between points in the set of points;

based on the determined physical proximity, identifying co-located segments of the predictive model that change positions together; and

refining positions of segments of the predictive model responsive to the co-located segments.

10. The method of claim 9 , wherein the co-located segments represent adjoining figures of the hand.

11. The method of claim 9 , wherein the co-located segments represent subcomponents of a same finger.

12. A computer implemented method of distinguishing between alternative motions between two observed locations of a control object in a three-dimensional (3D) sensory space, the method including:

accessing a first position and a second position of a segment of a control object;

receiving two or more alternative interpretations of movement from the first position to the second position;

obtaining a selection of an alternative interpretation with a lower extent of motion than other interpretations; and

using the alternative interpretation selected to interpret a control object's position and/or motion.

13. The method of claim 12 , wherein the control object is a hand.

14. The method of claim 12 , wherein the control object is a tool.

15. A system enabling updating a predictive model comprising:

at least one camera oriented towards a field of view;

a database comprising a plurality of electronically stored records, wherein individual records of the plurality of electronically stored records relates to a predictive model of a hand; and

an image analyzer coupled to the camera and the database and configured with logic to:

access a particular predictive model of the hand;

obtain using points in a set of points and the predictive model, a refined predictive model having refined positions of segments determined for the set of points; and

using the predictive model as refined to interpret a control object's position and/or motion.

16. The system of claim 15 , wherein the logic to obtain using the points and the predictive model, a refined predictive model further includes logic to:

select a reference vector and determine a difference in angle between surface normal directions determined from the points and the reference vector; and

use a magnitude of the difference to cluster the points.

17. The system of claim 16 , wherein the reference vector is orthogonal to the field of view.

18. The system of claim 16 , wherein the reference vector is along a longitudinal axis of the hand.

19. The system of claim 16 , wherein the reference vector is along a longitudinal axis of a portion of the hand.

20. A non-transitory computer readable medium storing processor executable instructions to distinguish between alternative motions between two observed locations of a control object in a three-dimensional (3D) sensory space, which instructions when executed by a processor implement actions including:

accessing a first position and a second position of a segment of a control object;

receiving two or more alternative interpretations of movement from the first position to the second position;

obtaining a selection of an alternative interpretation with a lower extent of motion than other interpretations; and

using the alternative interpretation selected to interpret a control object's position and/or motion.

Assignments (6)

Continuity (7)

References Cited (400)