IP Library Granted Patent US 9,747,696
Granted Patent B2
US 9,747,696 · App. 14/281,804 · Granted Aug 29, 2017

Systems and methods for providing normalized parameters of motions of objects in three-dimensional space

Inventor: David Holz (San Francisco, CA)
Assignee: Leap Motion, Inc.
G06T7/2086G06K9/00335G06K9/3233G06T7/251G06K2009/3291G06T2207/10016G06T2207/10021G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,747,696
App. No.
14/281,804
Granted
Aug 29, 2017
Kind
B2
Abstract

Systems and methods are disclosed for detecting user gestures using detection zones to save computational time and cost and/or to provide normalized position-based parameters, such as position coordinates or movement vectors. The detection zones may be established explicitly by a user or a computer application, or may instead be determined from the user's pattern of gestural activity. The detection zones may have three-dimensional (3D) boundaries or may be two-dimensional (2D) frames. The size and location of the detection zone may be adjusted based on the distance and direction between the user and the motion-capture system.

Claims (38)

1. A method of tracking a movement of an object in 3D space, the method comprising:

capturing a plurality of temporally sequential images of the object within the 3D space;

automatically defining a detection zone in the 3D space, the detection zone including at least a portion of the object;

computationally analyzing the images to determine movement parameters associated with, and describing movement of, the object portion as the object portion moves in at least three dimensions, including a first dimension, a second dimension and a third dimension freely through the 3D space at least partially within the detection zone;

computationally scaling the movement parameters to generate normalized parameters normalized in the at least three dimensions relative to the detection zone;

tracking occurrences of motions of the object falling outside of the detection zone and for occurrences of motions of the object falling outside of the detection zone, adjusting a value of a discard parameter to reflect the occurrence; and

comparing the discard parameter to a threshold and based upon a result of the comparing, altering the detection zone.

2. The method of claim 1 , wherein the detection zone has three-dimensional boundaries.

3. The method of claim 1 , wherein the detection zone has two-dimensional boundaries.

4. The method of claim 1 , further comprising altering a size of the detection zone to conform to movement of the object.

5. The method of claim 1 , further comprising computationally determining a discard parameter value, wherein the discard parameter value relates to a quantity of instances of the object being detected within the 3D space and outside of the detection zone.

6. The method of claim 1 , wherein the threshold is a predetermined threshold, the method further comprising enlarging the detection zone when the discard parameter is above the predetermined threshold value.

7. The method of claim 1 , wherein the threshold is a predetermined threshold, the method further comprising shrinking the detection zone when the discard parameter is below the predetermined threshold value.

8. The method of claim 1 , further comprising altering a position of the detection zone based on a detected position of the object.

9. The method of claim 1 , wherein a size of the detection zone is initially determined based on a distance between the object and a motion-capture system.

10. The method of claim 1 , wherein the movement parameters are rescaled based on dimensions of the detection zone.

11. The method of claim 1 , wherein the movement parameters are rescaled based on a maximum number of pixels in the captured images.

12. The method of claim 1 , further comprising computationally analyzing the images to determine movement parameters associated with the object's movement outside the detection zone;

wherein the computational analysis of the object outside the detection zone is coarser that the computational analysis of the object within the detection zone.

13. A system for tracking movement of an object in 3D space, the system comprising:

at least one camera oriented toward a field of view;

at least one light source for directing illumination into the field of view, the camera cooperating with the at least one light source to capture a plurality of temporally sequential images of the field of view when illuminated by the at least one light source; and

an image analyzer configured to:

automatically define a detection zone in 3D space, the detection zone including at least a portion of the object;

computationally analyze the images to determine movement parameters associated with, and describing movement of, the object portion as the object portion moves in at least three dimensions, including a first dimension, a second dimension and a third dimension freely through the 3D space at least partially within the detection zone; and

computationally rescale the movement parameters to generate normalized parameters normalized in the at least three dimensions relative to the detection zone;

tracking occurrences of motions of the object falling outside of the detection zone and for occurrences of motions of the object falling outside of the detection zone, adjust a value of a discard parameter to reflect the occurrence; and

compare the discard parameter to a threshold and based upon a result of the comparing, alter the detection zone.

14. The system of claim 13 , wherein the image analyzer is further configured to dynamically adjust a size of the detection zone based on the object's movements.

15. The system of claim 13 , wherein the image analyzer is further configured to computationally determine a discard parameter value, wherein the discard parameter value relates to a quantity of instances of the object being detected within the 3D space and outside of the detection zone.

16. The system of claim 13 , wherein the threshold is a predetermined threshold and wherein the image analyzer is further configured to enlarge the detection zone when the discard parameter is above the predetermined threshold value.

17. The system of claim 13 , wherein the threshold is a predetermined threshold and wherein the image analyzer is further configured to shrink the detection zone when the discard parameter is below the predetermined threshold value.

18. The system of claim 13 , wherein the image analyzer is further configured to adjust a position of the detection zone based on a position of the object.

19. The system of claim 13 , wherein the image analyzer is further configured to determine a size of the detection zone based on a distance between the object and the at least one camera.

20. The system of claim 13 , wherein the image analyzer is further configured to rescale the movement parameters based on dimensions of the detection zone.

21. The system of claim 13 , wherein the image analyzer is further configured to rescale the movement parameters based on a maximum number of pixels in the captured images.

22. The system of claim 13 , wherein the image analyzer is further configured computationally analyze the images to determine movement parameters associated with the object's movement outside the detection zone;

wherein the computational analysis of the object outside the detection zone is coarser that the computational analysis of the object within the detection zone.

Assignments (15)
SECURITY INTEREST Recorded Apr 6, 2026
From: SIM IP HXR LLC
To: UNITY MASTER LLC SERIES XIX
Reel/Frame 075365/0907 →
RELEASE OF SECURITY INTEREST Recorded Mar 27, 2026
From: TRIPLEPOINT CAPITAL LLC
To: ULTRAHAPTICS IP TWO LIMITED
Reel/Frame 075288/0661 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2026
From: ULTRAHAPTICS IP TWO LIMITED
To: SIM IP HXR LLC
Reel/Frame 075127/0488 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2026
From: ULTRAHAPTICS LIMITED; ULTRAHAPTICS IP LIMITED; ULTRAHAPTICS IP TWO LIMITED; ULTRALEAP LIMITED
To: SIM IP HXR LLC
Reel/Frame 074403/0797 →
SECURITY INTEREST Recorded Jun 10, 2020
From: LMI LIQUIDATING CO., LLC
To: TRIPLEPOINT CAPITAL LLC
Reel/Frame 052902/0571 →
SECURITY INTEREST Recorded Jun 5, 2020
From: ULTRAHAPTICS IP TWO LIMITED
To: LMI LIQUIDATING CO., LLC
Reel/Frame 052848/0240 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2020
From: LEAP MOTION, INC.
To: LMI LIQUIDATING CO., LLC.
Reel/Frame 052914/0871 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2020
From: LMI LIQUIDATING CO., LLC.
To: ULTRAHAPTICS IP TWO LIMITED
Reel/Frame 051580/0165 →
RELEASE OF SECURITY INTEREST Recorded Jul 31, 2019
From: HAYNES BEFFEL WOLFELD LLP
To: LEAP MOTION, INC.
Reel/Frame 049926/0631 →
RELEASE OF SECURITY INTEREST Recorded May 31, 2019
From: TRIPLEPOINT CAPITAL LLC
To: LEAP MOTION, INC.
Reel/Frame 049337/0130 →
SECURITY INTEREST Recorded Apr 11, 2019
From: LEAP MOTION, INC.
To: HAYNES BEFFEL WOLFELD LLP
Reel/Frame 048919/0109 →
TERMINATION OF SECURITY AGREEMENT Recorded Nov 7, 2018
From: THE FOUNDERS FUND IV, LP, AS COLLATERAL AGENT
To: LEAP MOTION, INC.
Reel/Frame 047444/0567 →
SECURITY INTEREST Recorded Oct 6, 2015
From: LEAP MOTION, INC.
To: THE FOUNDERS FUND IV, LP
Reel/Frame 036796/0151 →
SECURITY INTEREST Recorded Sep 21, 2015
From: LEAP MOTION, INC.
To: TRIPLEPOINT CAPITAL LLC
Reel/Frame 036644/0314 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 28, 2015
From: HOLZ, DAVID S.
To: LEAP MOTION, INC.
Reel/Frame 035511/0165 →
Continuity (2)
Provisional Application 61824666 · May 17, 2013
Related Publication 20140340524A1 · Nov 20, 2014