IP Library Granted Patent US 9,778,752
Granted Patent B2
US 9,778,752 · App. 15/392,920 · Granted Oct 3, 2017

Systems and methods for machine control

Inventor: David S. Holz (San Francisco, CA)
Assignee: Leap Motion, Inc.
G06F3/017G06K9/00523
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,778,752
App. No.
15/392,920
Granted
Oct 3, 2017
Kind
B2
Abstract

A region of space may be monitored for the presence or absence of one or more control objects, and object attributes and changes thereto may be interpreted as control information provided as input to a machine or application. In some embodiments, the region is monitored using a combination of scanning and image-based sensing.

Claims (56)

1. A computer implemented method for conducting machine control, the method comprising:

scanning a region of space, the scanning including:

directing at least two emission cycles, including a first emission cycle from a first hardware type and a second emission cycle from a second hardware type, to form at least two scan patterns that scan from an emission region to the region of space, a first scan pattern of the at least two scan patterns being different from a second scan pattern of the at least two scan patterns;

detecting a reflectance from the first scan pattern; and

determining that the detected reflectance from the first scan pattern indicates a presence of an object in the region of space;

determining a first object attribute set of one or more object attributes of the object for the first scan pattern;

determining a second object attribute set of one or more object attributes of the object for is the second scan pattern;

analyzing the first object attribute set and the second object attribute set to determine a control portion of the object;

directing a third emission cycle from hardware of the second hardware type to form the second scan pattern to determine a third object attribute set of one or more object attributes of the object;

comparing the second object attribute set and the third object attribute set to determine control information; and

responding to the determined control information according to response criteria.

2. The computer implemented method according to claim 1 ,

wherein the second object attribute set and the third object attribute set comprises attributes of the control portion of the object, and

wherein the comparing of the second object attribute set and the third object attribute set includes comparing control portion attributes selected from the second object attribute set with control portion attributes selected from the third object attribute set.

3. The computer implemented method according to claim 1 , wherein the response criteria includes determining whether to respond to the control information.

4. The computer implemented method according to claim 3 , wherein the second scan pattern is more refined than the first scan pattern.

5. The computer implemented method according to claim 4 , wherein the second scan pattern captures surface detail about the object.

6. The computer implemented method according to claim 5 , wherein the determining of the first object attribute set and the determining of the second object attribute set include determining control-portion attributes based at least in part on captured surface detail about the object.

7. The computer implemented method according to claim 1 , wherein the determining of the first object attribute set includes identifying a presence of a hand in the region of space.

8. The computer implemented method according to claim 7 , wherein the analyzing of the first object attribute set and the second object attribute set to determine the control portion of the object includes identifying a fingertip of the identified hand.

9. The computer implemented method of claim 8 , wherein the comparing of the second object attribute set and the third object attribute set to determine the control information includes identifying a movement of the identified fingertip.

10. The computer implemented method of claim 1 ,

wherein the first scan pattern is configured to provide sequential emissions from emitters of the emission region in a binary manner such that each of the emitters is turned on and off one at a time, and

wherein the second scan pattern is configured to provide simultaneously overlapping emissions from the emitters.

11. The computer implemented method of claim 1 ,

wherein the first scan pattern is configured to provide emissions from emitters of the emission region in a first order, and

wherein the second scan pattern is configured to provide emissions from other emitters of the emission region in a second order, which is different from the first order.

12. The computer implemented method of claim 1 ,

wherein the first scan pattern is configured to provide emissions from the emission region at a first rate, and

wherein the second scan pattern is configured to provide emissions from the emission region at a second rate, which is different from the first rate.

13. The computer implemented method of claim 1 , wherein the directing of the at least two emission cycles includes varying a first power state of a first light emitter at least partially in concurrence with varying a second power state of a second light emitter.

14. The computer implemented method of claim 1 , wherein the directing of the at least two emission cycles includes extinguishing a first light emitter completely before activating a second light emitter.

15. The computer implemented method of claim 1 , wherein the emission region includes a first emission point and a second emission point rotationally pivotable about one or more axes having an origin point within the emission region.

16. The computer implemented method of claim 15 , wherein the first emission point is the same as the second emission point.

17. A non-transitory computer readable storage medium impressed with computer program instructions for conducting machine control, the instructions, when executed on a processor, implement a method comprising:

scanning a region of space, the scanning including:

directing at least two emission cycles, including a first emission cycle from a first hardware type and a second emission cycle from a second hardware type, to form at least two scan patterns that scan from an emission region to the region of space, a first scan pattern of the at least two scan patterns being different from a second scan pattern of the at least two scan patterns;

detecting a reflectance from the first scan pattern; and

determining that the detected reflectance from the first scan pattern indicates a presence of an object in the region of space;

determining a first object attribute set of one or more object attributes of the object for the first scan pattern;

determining a second object attribute set of one or more object attributes of the object for the second scan pattern;

analyzing the first object attribute set and the second object attribute set to determine a control portion of the object;

directing a third emission cycle from hardware of the second hardware type to form the second scan pattern to determine a third object attribute set of one or more object attributes of the object;

comparing the second object attribute set and the third object attribute set to determine control information; and

responding to the determined control information according to response criteria.

18. A system including one or more processors coupled to memory, the memory loaded with computer instructions for conducting machine control, the instructions, when executed on the processors, implement actions comprising:

scanning a region of space, the scanning including:

directing at least two emission cycles, including a first emission cycle from a first hardware type and a second emission cycle from a second hardware type, to form at least two scan patterns that scan from an emission region to the region of space, a first scan pattern of the at least two scan patterns being different from a second scan pattern of the at least two scan patterns;

detecting a reflectance from the first scan pattern; and

determining that the detected reflectance from the first scan pattern indicates a presence of an object in the region of space;

determining a first object attribute set of one or more object attributes of the object for the first scan pattern;

determining a second object attribute set of one or more object attributes of the object for the second scan pattern;

analyzing the first object attribute set and the second object attribute set to determine a control portion of the object;

directing a third emission cycle from hardware of the second hardware type to form the second scan pattern to determine a third object attribute set of one or more object attributes of the object;

comparing the second object attribute set and the third object attribute set to determine control information; and

responding to the determined control information according to response criteria.

Assignments (12)
SECURITY INTEREST Recorded Apr 6, 2026
From: SIM IP HXR LLC
To: UNITY MASTER LLC SERIES XIX
Reel/Frame 075365/0907 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2026
From: ULTRAHAPTICS IP TWO LIMITED
To: SIM IP HXR LLC
Reel/Frame 075127/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2026
From: ULTRAHAPTICS LIMITED; ULTRAHAPTICS IP LIMITED; ULTRAHAPTICS IP TWO LIMITED; ULTRALEAP LIMITED
To: SIM IP HXR LLC
Reel/Frame 074403/0864 →
SECURITY INTEREST Recorded Jun 10, 2020
From: LMI LIQUIDATING CO., LLC
To: TRIPLEPOINT CAPITAL LLC
Reel/Frame 052902/0571 →
SECURITY INTEREST Recorded Jun 5, 2020
From: ULTRAHAPTICS IP TWO LIMITED
To: LMI LIQUIDATING CO., LLC
Reel/Frame 052848/0240 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2020
From: LEAP MOTION, INC.
To: LMI LIQUIDATING CO., LLC.
Reel/Frame 052914/0871 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2020
From: LMI LIQUIDATING CO., LLC.
To: ULTRAHAPTICS IP TWO LIMITED
Reel/Frame 051580/0165 →
RELEASE OF SECURITY INTEREST Recorded Jul 31, 2019
From: HAYNES BEFFEL WOLFELD LLP
To: LEAP MOTION, INC.
Reel/Frame 049926/0631 →
RELEASE OF SECURITY INTEREST Recorded May 31, 2019
From: TRIPLEPOINT CAPITAL LLC
To: LEAP MOTION, INC.
Reel/Frame 049337/0130 →
SECURITY INTEREST Recorded Apr 11, 2019
From: LEAP MOTION, INC.
To: HAYNES BEFFEL WOLFELD LLP
Reel/Frame 048919/0109 →
SECURITY INTEREST Recorded Dec 22, 2017
From: LEAP MOTION, INC.
To: TRIPLEPOINT CAPITAL LLC
Reel/Frame 044469/0592 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2016
From: HOLZ, DAVID S.
To: LEAP MOTION, INC.
Reel/Frame 040791/0526 →
Continuity (34)
Continuation 14280018 · May 16, 2014
Continuation 14106140 · Dec 13, 2013
Continuation In Part 13742953 · Jan 16, 2013
Continuation In Part 13414485 · Mar 7, 2012
Continuation 13724357 · Dec 21, 2012
Continuation In Part 14212485 · Mar 14, 2014
Continuation In Part 14154730 · Jan 14, 2014
Continuation In Part 14250758 · Apr 11, 2014
Continuation In Part 13414485 · Mar 7, 2012
Provisional Application 61724091 · Nov 8, 2012
Provisional Application 61587554 · Jan 17, 2012
Provisional Application 61792025 · Mar 15, 2013
Provisional Application 61800327 · Mar 15, 2013
Provisional Application 61801479 · Mar 15, 2013
Provisional Application 61825515 · May 20, 2013
Provisional Application 61825480 · May 20, 2013
Provisional Application 61877641 · Sep 13, 2013
Provisional Application 61816487 · Apr 26, 2013
Provisional Application 61824691 · May 17, 2013
Provisional Application 61752725 · Jan 15, 2013
Provisional Application 61752731 · Jan 15, 2013
Provisional Application 61752733 · Jan 15, 2013
Provisional Application 61791204 · Mar 15, 2013
Provisional Application 61808959 · Apr 5, 2013
Provisional Application 61808984 · Apr 5, 2013
Provisional Application 61872538 · Aug 30, 2013
Provisional Application 61871790 · Aug 29, 2013
Provisional Application 61873758 · Sep 4, 2013
Provisional Application 61898462 · Oct 31, 2013
Provisional Application 61811415 · Apr 12, 2013
Provisional Application 61886586 · Oct 3, 2013
Provisional Application 61952843 · Mar 13, 2014
Provisional Application 61873351 · Sep 3, 2013
Related Publication 20170160816A1 · Jun 8, 2017